Nov 07 02:25:39 devstack cinder-volume[75999]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 07 02:25:39 devstack cinder-volume[75999]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 07 02:25:39 devstack cinder-volume[75999]: we strongly recommend against using it for new projects.
Nov 07 02:25:39 devstack cinder-volume[75999]: If you are already using Eventlet, we recommend migrating to a different
Nov 07 02:25:39 devstack cinder-volume[75999]: framework.  For more detail see
Nov 07 02:25:39 devstack cinder-volume[75999]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 07 02:25:39 devstack cinder-volume[75999]:   import eventlet  # noqa
Nov 07 02:25:42 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:25:42 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:25:42 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:25:43 devstack cinder-volume[75999]: INFO dbcounter [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Registered counter for database cinder
Nov 07 02:25:43 devstack cinder-volume[75999]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG dbcounter [-] [75999] Writer thread running {{(pid=75999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:25:44 devstack cinder-volume[75999]: INFO cinder.rpc [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 07 02:25:44 devstack cinder-volume[75999]: INFO cinder.rpc [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:25:44 devstack cinder-volume[75999]: INFO cinder.volume.manager [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Determined volume DB was empty at startup.
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG cinder.volume.manager [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75999) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 07 02:25:44 devstack cinder-volume[75999]: INFO cinder.volume.manager [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 07 02:25:44 devstack cinder-volume[75999]: WARNING stevedore.named [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 07 02:25:44 devstack cinder-volume[75999]: WARNING castellan.key_manager [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:25:44 devstack cinder-volume[75999]: WARNING cinder.keymgr.conf_key_mgr [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG cinder.volume.drivers.lvm [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75999) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_concurrency.processutils [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_concurrency.processutils [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] CMD "cinder-rtstool verify" returned: 0 in 0.468s {{(pid=75999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:25:44 devstack cinder-volume[75999]: INFO cinder.rpc [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 07 02:25:44 devstack cinder-volume[75999]: INFO cinder.rpc [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 07 02:25:44 devstack cinder-volume[75999]: WARNING stevedore.named [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 07 02:25:44 devstack cinder-volume[75999]: WARNING castellan.key_manager [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:25:44 devstack cinder-volume[75999]: INFO cinder.volume.manager [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:25:44 devstack cinder-volume[75999]: INFO oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Starting 1 workers
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Started child 76164 {{(pid=75999) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Full set of CONF: {{(pid=75999) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] ******************************************************************************** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Configuration options gathered from: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] ================================================================================ {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] allow_availability_zone_fallback = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] allow_compression_on_image_upload = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] allowed_direct_url_schemes     = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] api_rate_limit                 = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] auth_strategy                  = keystone {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] az_cache_duration              = 3600 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[76164]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_availability_zone      = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_host                   = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_name                   = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_stats_polling_interval = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backup_api_class               = cinder.backup.api.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backup_name_template           = backup-%s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backup_use_same_host           = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backup_use_temp_snapshot       = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] chap_password                  = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] chap_username                  =  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cinder_internal_tenant_project_id = 3aa211f8cd5042029dcb46ddb1fc309a {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cinder_internal_tenant_user_id = 6d94b31fc82d46848a6763e7979f421e {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cloned_volume_same_az          = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cluster                        = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] compression_format             = gzip {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] config_dir                     = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] config_source                  = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] control_exchange               = openstack {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] debug                          = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] default_availability_zone      = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] default_group_type             = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] default_volume_type            = lvmdriver-1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] disk_geometry                  = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] driver_client_cert             = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] driver_client_cert_key         = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] driver_data_namespace          = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] driver_ssl_cert_path           = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] driver_ssl_cert_verify         = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] driver_use_ssl                 = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] enable_force_upload            = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] enable_new_services            = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] enable_unsupported_driver      = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] enforce_multipath_for_image_xfer = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] filter_function                = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance_api_insecure            = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance_api_servers             = ['http://192.168.122.26/image'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance_api_ssl_compression     = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance_ca_certificates_file    = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance_certfile                = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:44 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance_keyfile                 = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance_num_retries             = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance_request_timeout         = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] goodness_function              = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] graceful_shutdown_timeout      = 5 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] group_api_class                = cinder.group.api.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] host                           = devstack {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_compress_on_upload       = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_conversion_address_space_limit = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_conversion_cpu_limit     = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_conversion_disable       = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_introspection_address_space_limit = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_introspection_cpu_limit  = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_upload_use_cinder_backend = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_upload_use_internal_tenant = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_volume_cache_enabled     = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_volume_cache_max_count   = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] image_volume_cache_max_size_gb = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] init_host_max_objects_retrieval = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] iscsi_target_flags             =  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] iscsi_write_cache              = on {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] iser_helper                    = tgtadm {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] iser_ip_address                = 192.168.122.26 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] iser_port                      = 3260 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] log_color                      = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] log_config_append              = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] log_dir                        = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] log_file                       = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] log_options                    = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] log_rotate_interval            = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] log_rotate_interval_type       = days {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] log_rotation_type              = none {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[76164]: INFO cinder.volume.manager [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] max_age                        = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] max_logfile_count              = 30 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] max_logfile_size_mb            = 200 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] max_over_subscription_ratio    = 20.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] message_reap_interval          = 86400 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] message_ttl                    = 2592000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] migration_create_volume_timeout_secs = 300 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] monkey_patch                   = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] monkey_patch_modules           = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] my_ip                          = 192.168.122.26 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] no_snapshot_gb_quota           = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] num_iser_scan_tries            = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] num_shell_tries                = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] num_volume_device_scan_tries   = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] nvmeof_conn_info_version       = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] nvmet_ns_id                    = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] nvmet_port_id                  = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] osapi_max_limit                = 1000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] osapi_volume_ext_list          = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] osapi_volume_listen_port       = 8776 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] osapi_volume_use_ssl           = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] osapi_volume_workers           = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] per_volume_size_limit          = -1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] periodic_fuzzy_delay           = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] periodic_interval              = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] public_endpoint                = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] publish_errors                 = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] quota_backup_gigabytes         = 1000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] quota_backups                  = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] quota_gigabytes                = 1000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] quota_groups                   = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] quota_snapshots                = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] quota_volumes                  = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] rate_limit_burst               = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] rate_limit_except_level        = CRITICAL {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] rate_limit_interval            = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] reinit_driver_count            = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] replication_device             = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] report_discard_supported       = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] report_interval                = 120 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] reservation_clean_interval     = 86400 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] reservation_expire             = 86400 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] reserved_image_namespaces      = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] reserved_percentage            = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] rpc_response_timeout           = 120 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] run_external_periodic_tasks    = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] scst_target_driver             = iscsi {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] scst_target_iqn_name           = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_down_time              = 720 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] shell_completion               = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] snapshot_name_template         = snapshot-%s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] snapshot_same_host             = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] split_loggers                  = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] state_path                     = /opt/stack/data/cinder {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] storage_availability_zone      = nova {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] storage_protocol               = iSCSI {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] syslog_log_facility            = LOG_USER {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] target_helper                  = lioadm {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] target_ip_address              = 192.168.122.26 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] target_port                    = 3260 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] target_protocol                = iscsi {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] target_secondary_ip_addresses  = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] trace_flags                    = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] transport_url                  = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] until_refresh                  = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] use_chap_auth                  = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] use_default_quota_class        = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] use_journal                    = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] use_json                       = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] use_multipath_for_image_xfer   = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] use_stderr                     = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] use_syslog                     = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] verify_glance_signatures       = enabled {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_api_class               = cinder.volume.api.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_backend_name            = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_clear                   = zero {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_clear_ionice            = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_clear_size              = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_copy_bps_limit          = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_dd_blocksize            = 1M {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_name_template           = volume-%s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_service_inithost_offload = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volume_usage_audit_period      = month {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] zoning_mode                    = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_concurrency.disable_process_locking = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.auth_section = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.auth_type   = password {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.auth_version = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.cache       = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.certfile    = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.include_service_catalog = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.insecure    = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.interface   = public {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.keyfile     = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_password = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcache_username = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.region_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.service_type = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.26/identity {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.backend                  = dogpile.cache.null {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.backend_argument         = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.backend_expiration_time  = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.config_prefix            = cache.oslo {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.debug_cache_backend      = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.enable_retry_client      = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.enable_socket_keepalive  = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.enabled                  = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.expiration_time          = 600 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.hashclient_retry_attempts = 2 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.memcache_dead_retry      = 300 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.memcache_sasl_enabled    = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.password                 = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.proxies                  = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.redis_db                 = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.redis_server             = localhost:6379 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.retry_attempts           = 2 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.retry_delay              = 0.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.socket_keepalive_count   = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.socket_keepalive_idle    = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.socket_keepalive_interval = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.socket_timeout           = 1.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.tls_allowed_ciphers      = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.tls_cafile               = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.tls_certfile             = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.tls_enabled              = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.tls_keyfile              = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cache.username                 = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] coordination.backend_url       = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.asyncio_connection    = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.asyncio_slave_connection = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.backend               = sqlalchemy {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.connection            = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.connection_debug      = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.connection_parameters =  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.connection_recycle_time = 3600 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.connection_trace      = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.db_inc_retry_interval = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.db_max_retries        = 20 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.db_max_retry_interval = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.db_retry_interval     = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.max_overflow          = 50 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.max_pool_size         = 5 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.max_retries           = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.mysql_wsrep_sync_wait = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.pool_timeout          = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.retry_interval        = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.slave_connection      = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.sqlite_synchronous    = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.synchronous_reader    = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] database.use_db_reconnect      = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_tracing.insecure = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler.connection_string     = messaging:// {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler.enabled               = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler.es_doc_type           = notification {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler.es_scroll_size        = 10000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler.es_scroll_time        = 2m {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler.filter_error_trace    = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler.hmac_keys             = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler.sentinel_service_name = mymaster {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler.socket_timeout        = 0.1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler.trace_requests        = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler.trace_sqlalchemy      = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler_jaeger.process_tags   = {} {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler_jaeger.service_name_prefix = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] profiler_otlp.service_name_prefix = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_policy.enforce_new_defaults = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_policy.policy_default_rule = default {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.060s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] privsep_osbrick.group          = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] privsep_osbrick.helper_command = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] privsep_osbrick.user           = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cinder_sys_admin.group         = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cinder_sys_admin.helper_command = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] cinder_sys_admin.user          = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.auth_section      = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.auth_type         = password {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.cafile            = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.certfile          = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.collect_timing    = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.insecure          = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.keyfile           = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.send_service_user_token = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.split_loggers     = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.timeout           = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.tls_ciphers       = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] service_user.tls_min_version   = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.auth_section            = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.auth_type               = password {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.certfile                = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.collect_timing          = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.insecure                = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.keyfile                 = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.region_name             = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.split_loggers           = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.timeout                 = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.tls_ciphers             = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] glance.tls_min_version         = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.backend_availability_zone = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack sudo[76168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 07 02:25:45 devstack sudo[76168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.chap_password = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.chap_username =  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.disk_geometry = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.driver_client_cert = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.driver_client_cert_key = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.driver_data_namespace = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.driver_use_ssl = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.extra_capabilities = {} {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.filter_function = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.goodness_function = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.iscsi_target_flags =  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.iscsi_write_cache = on {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.iser_ip_address = 192.168.122.26 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.iser_port     = 3260 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.lvm_share_target = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.lvm_type      = auto {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.num_shell_tries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.replication_device = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.report_discard_supported = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.reserved_percentage = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.target_helper = tgtadm {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.target_ip_address = 192.168.122.26 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.target_port   = 3260 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.target_protocol = iscsi {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.trace_flags   = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.unique_fqdn_network = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.use_chap_auth = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.volume_backend_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.volume_clear  = zero {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.volume_clear_ionice = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.volume_clear_size = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_reports.file_event_handler = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_reports.log_dir           = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.backend_host       = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.chap_password      = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.chap_username      = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.disk_geometry      = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.driver_client_cert = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.extra_capabilities = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.filter_function    = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.goodness_function  = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.iser_helper        = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.iser_port          = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.lvm_type           = auto {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.replication_device = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.report_discard_supported = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.reserved_percentage = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.scst_target_driver = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.storage_protocol   = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.target_ip_address  = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.target_port        = 3260 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.trace_flags        = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.volume_clear       = zero {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] lvmdriver-1.volumes_dir        = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_notifications.driver = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_notifications.retry = -1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] key_manager.fixed_key          = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.barbican_api_version  = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.barbican_endpoint     = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.barbican_endpoint_type = public {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.barbican_region_name  = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.cafile                = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.certfile              = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.collect_timing        = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.insecure              = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.keyfile               = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.number_of_retries     = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.retry_delay           = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.send_service_user_token = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.split_loggers         = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.timeout               = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.tls_ciphers           = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.tls_min_version       = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.verify_ssl            = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican.verify_ssl_path       = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican_service_user.auth_section = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican_service_user.auth_type = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican_service_user.cafile   = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican_service_user.certfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican_service_user.collect_timing = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican_service_user.insecure = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican_service_user.keyfile  = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican_service_user.split_loggers = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican_service_user.timeout  = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican_service_user.tls_ciphers = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] barbican_service_user.tls_min_version = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.approle_role_id          = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.approle_secret_id        = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.auth_method              = approle {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.auth_path                = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.kv_mountpoint            = secret {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.kv_path                  = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.kv_version               = 2 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.namespace                = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.root_token_id            = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.ssl_ca_crt_file          = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.timeout                  = 60.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.token_file               = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.token_role               = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.use_ssl                  = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:25:45 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] ******************************************************************************** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 07 02:25:45 devstack sudo[76168]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.364s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:45 devstack sudo[76267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:45 devstack sudo[76267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:45 devstack sudo[76267]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.299s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:25:45 devstack cinder-volume[76164]: INFO cinder.brick.local_dev.lvm [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:45 devstack sudo[76392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:25:45 devstack sudo[76392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:46 devstack sudo[76392]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:46 devstack cinder-volume[76164]: DEBUG cinder.brick.local_dev.lvm [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76164) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 07 02:25:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:46 devstack sudo[76477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:46 devstack sudo[76477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:46 devstack sudo[76477]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.485s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:46 devstack sudo[76657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:46 devstack sudo[76657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:46 devstack sudo[76657]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:46 devstack sudo[76750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 07 02:25:46 devstack sudo[76750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:47 devstack sudo[76750]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:47 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.296s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:47 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:47 devstack sudo[76780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:25:47 devstack sudo[76780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:47 devstack sudo[76780]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:47 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:47 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:47 devstack sudo[76838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:25:47 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:47 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:47 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:47 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:47 devstack sudo[76868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:47 devstack sudo[76868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:48 devstack sudo[76868]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:48 devstack sudo[76877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:48 devstack sudo[76877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:48 devstack sudo[76877]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:48 devstack sudo[76967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:48 devstack sudo[76967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:48 devstack sudo[76967]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:48 devstack cinder-volume[76164]: INFO cinder.volume.drivers.lvm [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:48 devstack sudo[76971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:48 devstack sudo[76971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:48 devstack sudo[76971]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:25:48 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:48 devstack sudo[76974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:25:48 devstack sudo[76974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:49 devstack sudo[76974]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:49 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:49 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:49 devstack sudo[76977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:49 devstack sudo[76977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:49 devstack sudo[76977]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:49 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:49 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:49 devstack sudo[76980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:49 devstack sudo[76980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:49 devstack sudo[76980]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:49 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:49 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:49 devstack sudo[76983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:49 devstack sudo[76983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:49 devstack sudo[76983]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:49 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:49 devstack cinder-volume[76164]: INFO cinder.volume.driver [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Driver hasn't implemented _init_vendor_properties()
Nov 07 02:25:49 devstack cinder-volume[76164]: DEBUG cinder.volume.driver [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76164) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG oslo_db.sqlalchemy.engines [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writer thread running {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG cinder.db.api [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Building query based on filter {{(pid=76164) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG cinder.image.image_utils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76164) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 07 02:25:50 devstack cinder-volume[76164]: INFO cinder.keymgr.migration [None req-2ae77e09-760d-41af-baed-49861e58027b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:50 devstack sudo[76986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:25:50 devstack sudo[76986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:50 devstack sudo[76986]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:50 devstack sudo[76990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:50 devstack sudo[76990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:50 devstack sudo[76990]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:50 devstack sudo[76994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:50 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:50 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:50 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:50 devstack sudo[76998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:50 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:51 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:51 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:51 devstack cinder-volume[76164]: DEBUG cinder.manager [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Notifying Schedulers of capabilities ... {{(pid=76164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:25:51 devstack cinder-volume[76164]: INFO cinder.volume.manager [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Driver initialization completed successfully.
Nov 07 02:25:51 devstack cinder-volume[76164]: INFO cinder.manager [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Initiating service 2 cleanup
Nov 07 02:25:51 devstack cinder-volume[76164]: INFO cinder.manager [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Service 2 cleanup completed.
Nov 07 02:25:51 devstack cinder-volume[76164]: DEBUG cinder.service [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Creating RPC server for service cinder-volume {{(pid=76164) start /opt/stack/cinder/cinder/service.py:231}}
Nov 07 02:25:51 devstack cinder-volume[76164]: DEBUG cinder.service [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76164) start /opt/stack/cinder/cinder/service.py:237}}
Nov 07 02:25:51 devstack cinder-volume[76164]: INFO cinder.volume.manager [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 07 02:25:51 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:25:51 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:51 devstack sudo[77001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:25:51 devstack sudo[77001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:51 devstack sudo[77001]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:51 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:51 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:51 devstack sudo[77007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:51 devstack sudo[77007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:51 devstack sudo[77007]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:51 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:51 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:51 devstack sudo[77012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:51 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:52 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:52 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:52 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:52 devstack sudo[77015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:52 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:52 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:52 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:52 devstack cinder-volume[76164]: INFO cinder.volume.manager [None req-d426cf2b-346e-437f-87f4-33104f975445 None None] Driver post RPC initialization completed successfully.
Nov 07 02:25:54 devstack cinder-volume[75999]: DEBUG dbcounter [-] [75999] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:26:02 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:26:02 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:26:45 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:26:45 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:26:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:26:45 devstack sudo[78919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:26:45 devstack sudo[78919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:26:45 devstack sudo[78919]: pam_unix(sudo:session): session closed for user root
Nov 07 02:26:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:26:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:26:45 devstack sudo[78922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:26:45 devstack sudo[78922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:26:45 devstack sudo[78922]: pam_unix(sudo:session): session closed for user root
Nov 07 02:26:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:26:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:26:46 devstack sudo[78925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:26:46 devstack sudo[78925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:26:46 devstack sudo[78925]: pam_unix(sudo:session): session closed for user root
Nov 07 02:26:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:26:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:26:46 devstack sudo[78928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:26:46 devstack sudo[78928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:26:46 devstack sudo[78928]: pam_unix(sudo:session): session closed for user root
Nov 07 02:26:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:26:46 devstack cinder-volume[76164]: DEBUG cinder.manager [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Notifying Schedulers of capabilities ... {{(pid=76164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:26:46 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running periodic task VolumeManager._thread_info {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:26:46 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] thread count: 6 {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:26:46 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] thread info: [<_MainThread(MainThread, started 131002101186688)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131001990522304)>, <Thread(Thread-3 (stat_writer), started daemon 131001991023872)>, <Thread(Rabbit-heartbeat, started daemon 131001985978240)>, <Thread(Thread-5 (_runner), started daemon 131001986030912)>, <Thread(Thread-7 (_runner), started daemon 131001986175680)>] {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:27:45 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:27:45 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:27:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:27:45 devstack sudo[82209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:27:45 devstack sudo[82209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:27:45 devstack sudo[82209]: pam_unix(sudo:session): session closed for user root
Nov 07 02:27:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:27:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:27:45 devstack sudo[82216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:27:45 devstack sudo[82216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:27:46 devstack sudo[82216]: pam_unix(sudo:session): session closed for user root
Nov 07 02:27:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:27:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:27:46 devstack sudo[82224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:27:46 devstack sudo[82224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:27:46 devstack sudo[82224]: pam_unix(sudo:session): session closed for user root
Nov 07 02:27:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:27:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:27:46 devstack sudo[82232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:27:46 devstack sudo[82232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:27:46 devstack sudo[82232]: pam_unix(sudo:session): session closed for user root
Nov 07 02:27:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:27:46 devstack cinder-volume[76164]: DEBUG cinder.manager [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Notifying Schedulers of capabilities ... {{(pid=76164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:27:46 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running periodic task VolumeManager._thread_info {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:27:46 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] thread count: 6 {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:27:46 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] thread info: [<_MainThread(MainThread, started 131002101186688)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131001990522304)>, <Thread(Thread-3 (stat_writer), started daemon 131001991023872)>, <Thread(Rabbit-heartbeat, started daemon 131001985978240)>, <Thread(Thread-5 (_runner), started daemon 131001986030912)>, <Thread(Thread-7 (_runner), started daemon 131001986175680)>] {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:28:02 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:SELECT=1 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:28:02 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:UPDATE=1 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:29:45 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:29:45 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:29:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:45 devstack sudo[85570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:29:45 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:45 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:45 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:45 devstack sudo[85573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:29:45 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:46 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:46 devstack sudo[85576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:29:46 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:46 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:46 devstack sudo[85602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:29:46 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:46 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:46 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:46 devstack cinder-volume[76164]: DEBUG cinder.manager [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Notifying Schedulers of capabilities ... {{(pid=76164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:29:46 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] Running periodic task VolumeManager._thread_info {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:29:46 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] thread count: 6 {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:29:46 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-3211b774-b951-445e-a8dc-41c97ec90a60 None None] thread info: [<_MainThread(MainThread, started 131002101186688)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131001990522304)>, <Thread(Thread-3 (stat_writer), started daemon 131001991023872)>, <Thread(Rabbit-heartbeat, started daemon 131001985978240)>, <Thread(Thread-5 (_runner), started daemon 131001986030912)>, <Thread(Thread-7 (_runner), started daemon 131001986175680)>] {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:30:02 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:SELECT=1 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:30:02 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:UPDATE=1 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:30:13 devstack cinder-volume[75999]: INFO oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Caught SIGTERM, stopping children
Nov 07 02:30:13 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Acquiring lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:30:13 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Acquired lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:30:13 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Releasing lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:30:13 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Stop services. {{(pid=75999) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 07 02:30:13 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Killing children. {{(pid=75999) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 07 02:30:13 devstack cinder-volume[75999]: INFO oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Waiting on 1 children to exit
Nov 07 02:30:16 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Acquiring lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:30:16 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Acquired lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:30:16 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Releasing lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:30:16 devstack cinder-volume[76164]: WARNING amqp [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 07 02:30:16 devstack cinder-volume[76164]: WARNING amqp [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 07 02:30:16 devstack cinder-volume[75999]: INFO oslo_service.backend._eventlet.service [None req-ec6bd02b-3bc2-41e6-a584-1f400a550665 None None] Child 76164 exited with status 0
Nov 07 02:30:16 devstack cinder-volume[86214]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 07 02:30:16 devstack cinder-volume[86214]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 07 02:30:16 devstack cinder-volume[86214]: we strongly recommend against using it for new projects.
Nov 07 02:30:16 devstack cinder-volume[86214]: If you are already using Eventlet, we recommend migrating to a different
Nov 07 02:30:16 devstack cinder-volume[86214]: framework.  For more detail see
Nov 07 02:30:16 devstack cinder-volume[86214]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 07 02:30:16 devstack cinder-volume[86214]:   import eventlet  # noqa
Nov 07 02:30:18 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:30:18 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:30:18 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:30:19 devstack cinder-volume[86214]: INFO dbcounter [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Registered counter for database cinder
Nov 07 02:30:19 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:30:19 devstack cinder-volume[86214]: DEBUG dbcounter [-] [86214] Writer thread running {{(pid=86214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:30:19 devstack cinder-volume[86214]: INFO cinder.rpc [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 07 02:30:19 devstack cinder-volume[86214]: INFO cinder.rpc [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 07 02:30:19 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:30:20 devstack cinder-volume[86214]: INFO cinder.volume.manager [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Determined volume DB was empty at startup.
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG cinder.volume.manager [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86214) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 07 02:30:20 devstack cinder-volume[86214]: INFO cinder.volume.manager [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 07 02:30:20 devstack cinder-volume[86214]: WARNING stevedore.named [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 07 02:30:20 devstack cinder-volume[86214]: WARNING castellan.key_manager [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:30:20 devstack cinder-volume[86214]: WARNING cinder.keymgr.conf_key_mgr [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:30:20 devstack cinder-volume[86214]: INFO cinder.volume.manager [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:30:20 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Starting 1 workers
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Started child 86433 {{(pid=86214) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Full set of CONF: {{(pid=86214) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] ******************************************************************************** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Configuration options gathered from: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] ================================================================================ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] allow_availability_zone_fallback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] allow_compression_on_image_upload = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] allowed_direct_url_schemes     = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] api_rate_limit                 = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] auth_strategy                  = keystone {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_availability_zone      = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_host                   = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_name                   = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_stats_polling_interval = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backup_api_class               = cinder.backup.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backup_name_template           = backup-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backup_use_same_host           = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backup_use_temp_snapshot       = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86433]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] chap_password                  = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] chap_username                  =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cinder_internal_tenant_project_id = 3aa211f8cd5042029dcb46ddb1fc309a {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cinder_internal_tenant_user_id = 6d94b31fc82d46848a6763e7979f421e {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cluster                        = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] compression_format             = gzip {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] config_dir                     = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] config_source                  = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] control_exchange               = openstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] debug                          = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] default_availability_zone      = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] default_group_type             = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] default_volume_type            = QuobyteHD {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] disk_geometry                  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] driver_client_cert             = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] driver_client_cert_key         = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] driver_data_namespace          = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] driver_ssl_cert_path           = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] driver_ssl_cert_verify         = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] driver_use_ssl                 = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] enable_new_services            = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] enable_unsupported_driver      = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] enforce_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] filter_function                = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance_api_insecure            = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance_api_servers             = ['http://192.168.122.26/image'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance_api_ssl_compression     = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance_ca_certificates_file    = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance_certfile                = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance_keyfile                 = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance_num_retries             = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance_request_timeout         = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] goodness_function              = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] graceful_shutdown_timeout      = 5 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] group_api_class                = cinder.group.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] host                           = devstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_compress_on_upload       = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_conversion_address_space_limit = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_conversion_cpu_limit     = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_conversion_disable       = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_introspection_address_space_limit = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_introspection_cpu_limit  = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_upload_use_cinder_backend = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_upload_use_internal_tenant = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_volume_cache_enabled     = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_volume_cache_max_count   = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] image_volume_cache_max_size_gb = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] init_host_max_objects_retrieval = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] iscsi_target_flags             =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] iscsi_write_cache              = on {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] iser_helper                    = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] iser_ip_address                = 192.168.122.26 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] iser_port                      = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] log_color                      = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] log_config_append              = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] log_dir                        = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] log_file                       = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] log_options                    = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] log_rotate_interval            = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] log_rotate_interval_type       = days {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] log_rotation_type              = none {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] max_age                        = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] max_logfile_count              = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] max_logfile_size_mb            = 200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] max_over_subscription_ratio    = 20.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] message_reap_interval          = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] message_ttl                    = 2592000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] migration_create_volume_timeout_secs = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] monkey_patch                   = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] monkey_patch_modules           = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] my_ip                          = 192.168.122.26 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] no_snapshot_gb_quota           = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] num_iser_scan_tries            = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] num_shell_tries                = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] num_volume_device_scan_tries   = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] nvmeof_conn_info_version       = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] nvmet_ns_id                    = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] nvmet_port_id                  = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] osapi_max_limit                = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] osapi_volume_ext_list          = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] osapi_volume_listen_port       = 8776 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] osapi_volume_use_ssl           = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] osapi_volume_workers           = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] per_volume_size_limit          = -1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] periodic_fuzzy_delay           = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] periodic_interval              = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] public_endpoint                = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] publish_errors                 = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] quota_backup_gigabytes         = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] quota_backups                  = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] quota_gigabytes                = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] quota_groups                   = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] quota_snapshots                = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] quota_volumes                  = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] rate_limit_burst               = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] rate_limit_except_level        = CRITICAL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] rate_limit_interval            = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] reinit_driver_count            = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] replication_device             = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] report_discard_supported       = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] report_interval                = 120 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] reservation_clean_interval     = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] reservation_expire             = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] reserved_image_namespaces      = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] reserved_percentage            = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] rpc_response_timeout           = 120 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] run_external_periodic_tasks    = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] scst_target_driver             = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] scst_target_iqn_name           = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_down_time              = 720 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] shell_completion               = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] snapshot_name_template         = snapshot-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] split_loggers                  = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] state_path                     = /opt/stack/data/cinder {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] storage_availability_zone      = nova {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] storage_protocol               = iSCSI {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] syslog_log_facility            = LOG_USER {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] target_helper                  = lioadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] target_ip_address              = 192.168.122.26 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] target_port                    = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] target_protocol                = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] target_secondary_ip_addresses  = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] trace_flags                    = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] transport_url                  = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] until_refresh                  = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] use_chap_auth                  = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] use_default_quota_class        = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] use_journal                    = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] use_json                       = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] use_multipath_for_image_xfer   = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] use_stderr                     = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] use_syslog                     = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] verify_glance_signatures       = enabled {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_api_class               = cinder.volume.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_backend_name            = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_clear                   = zero {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_clear_ionice            = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_clear_size              = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_copy_bps_limit          = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_dd_blocksize            = 1M {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_name_template           = volume-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_service_inithost_offload = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volume_usage_audit_period      = month {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] zoning_mode                    = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_concurrency.disable_process_locking = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.auth_type   = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86433]: INFO cinder.volume.manager [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.auth_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86433]: DEBUG cinder.volume.drivers.remotefs [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86433) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.cache       = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.certfile    = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.include_service_catalog = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.insecure    = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.interface   = public {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.keyfile     = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcache_username = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.region_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.service_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.26/identity {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.backend                  = dogpile.cache.null {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.backend_argument         = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.backend_expiration_time  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.config_prefix            = cache.oslo {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.debug_cache_backend      = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.enable_retry_client      = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.enable_socket_keepalive  = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.enabled                  = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.expiration_time          = 600 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.hashclient_retry_attempts = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.memcache_dead_retry      = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.memcache_sasl_enabled    = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.password                 = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.proxies                  = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.redis_db                 = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.redis_server             = localhost:6379 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.retry_attempts           = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.retry_delay              = 0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.socket_keepalive_count   = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.socket_keepalive_idle    = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.socket_keepalive_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.socket_timeout           = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.tls_allowed_ciphers      = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.tls_cafile               = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.tls_certfile             = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.tls_enabled              = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.tls_keyfile              = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cache.username                 = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] coordination.backend_url       = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.asyncio_connection    = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.asyncio_slave_connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.backend               = sqlalchemy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.connection            = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.connection_debug      = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.connection_parameters =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.connection_recycle_time = 3600 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.connection_trace      = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.db_inc_retry_interval = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.db_max_retries        = 20 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.db_max_retry_interval = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.db_retry_interval     = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.max_overflow          = 50 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.max_pool_size         = 5 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.max_retries           = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.mysql_wsrep_sync_wait = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.pool_timeout          = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.retry_interval        = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.slave_connection      = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.sqlite_synchronous    = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.synchronous_reader    = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] database.use_db_reconnect      = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_tracing.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler.connection_string     = messaging:// {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler.enabled               = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler.es_doc_type           = notification {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler.es_scroll_size        = 10000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler.es_scroll_time        = 2m {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler.filter_error_trace    = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler.hmac_keys             = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler.sentinel_service_name = mymaster {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler.socket_timeout        = 0.1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler.trace_requests        = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler.trace_sqlalchemy      = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler_jaeger.process_tags   = {} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler_jaeger.service_name_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] profiler_otlp.service_name_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_policy.enforce_new_defaults = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_policy.policy_default_rule = default {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] privsep_osbrick.group          = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] privsep_osbrick.helper_command = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] privsep_osbrick.user           = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cinder_sys_admin.group         = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cinder_sys_admin.helper_command = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] cinder_sys_admin.user          = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.auth_section      = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.auth_type         = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.cafile            = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.certfile          = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.collect_timing    = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.insecure          = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.keyfile           = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.send_service_user_token = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.split_loggers     = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.timeout           = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.tls_ciphers       = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] service_user.tls_min_version   = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.auth_section            = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.auth_type               = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.certfile                = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.collect_timing          = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.insecure                = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.keyfile                 = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.region_name             = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.split_loggers           = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.timeout                 = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.tls_ciphers             = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] glance.tls_min_version         = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.backend_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.chap_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.chap_username =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.disk_geometry = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.driver_client_cert = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.driver_client_cert_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.driver_data_namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.driver_use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.extra_capabilities = {} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.filter_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.goodness_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.iscsi_target_flags =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.iscsi_write_cache = on {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.iser_ip_address = 192.168.122.26 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.iser_port     = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nas_host      =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nas_login     = admin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nas_mount_options = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nas_password  = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nas_private_key =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nas_share_path =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.num_shell_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.quobyte_volume_url = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.replication_device = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.report_discard_supported = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.reserved_percentage = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.target_helper = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.target_ip_address = 192.168.122.26 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.target_port   = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.target_protocol = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.trace_flags   = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.unique_fqdn_network = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.use_chap_auth = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.volume_backend_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86433]: DEBUG cinder.volume.drivers.quobyte [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86433) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 07 02:30:20 devstack cinder-volume[86433]: WARNING cinder.volume.drivers.quobyte [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 07 02:30:20 devstack cinder-volume[86433]: WARNING cinder.volume.drivers.quobyte [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.volume_clear  = zero {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.volume_clear_ionice = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.volume_clear_size = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Running cmd (subprocess): mount.quobyte {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_reports.file_event_handler = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_reports.log_dir           = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.backend_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.backend_host         = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.chap_password        = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.chap_username        = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.disk_geometry        = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.driver_client_cert   = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.driver_data_namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.extra_capabilities   = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.filter_function      = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.goodness_function    = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.iser_helper          = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.iser_ip_address      = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.iser_port            = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nas_host             = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nas_login            = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nas_mount_options    = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nas_password         = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nas_private_key      = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nas_share_path       = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.num_shell_tries      = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.replication_device   = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.report_discard_supported = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.reserved_percentage  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.scst_target_driver   = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.storage_protocol     = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.target_helper        = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.target_ip_address    = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.target_port          = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.target_prefix        = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.target_protocol      = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.trace_flags          = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.use_chap_auth        = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.volume_clear         = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.volume_clear_size    = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] QuobyteHD.volumes_dir          = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_notifications.driver = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_notifications.retry = -1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] key_manager.fixed_key          = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.barbican_api_version  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.barbican_endpoint     = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.barbican_endpoint_type = public {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.barbican_region_name  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.cafile                = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.certfile              = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.collect_timing        = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.insecure              = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.keyfile               = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.number_of_retries     = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.retry_delay           = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.send_service_user_token = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.split_loggers         = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.timeout               = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.tls_ciphers           = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.tls_min_version       = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.verify_ssl            = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican.verify_ssl_path       = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican_service_user.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican_service_user.auth_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican_service_user.cafile   = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican_service_user.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican_service_user.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican_service_user.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican_service_user.keyfile  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican_service_user.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican_service_user.timeout  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican_service_user.tls_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] barbican_service_user.tls_min_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.approle_role_id          = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.approle_secret_id        = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.auth_method              = approle {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.auth_path                = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.kv_mountpoint            = secret {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack quobyte-client[86434]: Reading configuration file: /etc/quobyte/client.cfg
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.kv_path                  = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.kv_version               = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.namespace                = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.root_token_id            = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.ssl_ca_crt_file          = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.timeout                  = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.token_file               = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack quobyte-client[86434]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.token_role               = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.use_ssl                  = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:20 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] ******************************************************************************** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 07 02:30:20 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] CMD "mount.quobyte" returned: 1 in 0.145s {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:20 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:30:20 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:30:20 devstack cinder-volume[86433]: DEBUG cinder.volume.drivers.quobyte [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=86433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:30:20 devstack cinder-volume[86433]: INFO cinder.volume.drivers.quobyte [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c ...
Nov 07 02:30:20 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 -c /etc/quobyte/client-cinder.cfg {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:20 devstack sudo[86439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 -c /etc/quobyte/client-cinder.cfg
Nov 07 02:30:20 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:30:21 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.418s {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:21 devstack cinder-volume[86433]: INFO cinder.volume.drivers.quobyte [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c succeeded
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG cinder.volume.drivers.quobyte [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=86433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.432s {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:21 devstack sudo[86541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:30:21 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:30:21 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.246s {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:21 devstack cinder-volume[86433]: INFO cinder.volume.driver [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Driver hasn't implemented _init_vendor_properties()
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG cinder.volume.driver [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7832832336426, 'free_capacity_gb': 1773.7832832336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86433) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_db.sqlalchemy.engines [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG dbcounter [-] [86433] Writer thread running {{(pid=86433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG cinder.db.api [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Building query based on filter {{(pid=86433) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG cinder.image.image_utils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86433) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 07 02:30:21 devstack cinder-volume[86433]: INFO cinder.keymgr.migration [None req-3aca48d9-cb39-4629-9f9c-9b6ca5b1bbbd None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG cinder.volume.drivers.quobyte [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=86433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG cinder.volume.drivers.quobyte [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=86433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:21 devstack sudo[86544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:30:21 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:30:21 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.240s {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG cinder.manager [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Notifying Schedulers of capabilities ... {{(pid=86433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:30:21 devstack cinder-volume[86433]: INFO cinder.volume.manager [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Driver initialization completed successfully.
Nov 07 02:30:21 devstack cinder-volume[86433]: INFO cinder.manager [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Initiating service 3 cleanup
Nov 07 02:30:21 devstack cinder-volume[86433]: INFO cinder.manager [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Service 3 cleanup completed.
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG cinder.service [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Creating RPC server for service cinder-volume {{(pid=86433) start /opt/stack/cinder/cinder/service.py:231}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG cinder.service [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86433) start /opt/stack/cinder/cinder/service.py:237}}
Nov 07 02:30:21 devstack cinder-volume[86433]: INFO cinder.volume.manager [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG cinder.volume.drivers.quobyte [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=86433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG cinder.volume.drivers.quobyte [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=86433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:30:21 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:21 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:30:21 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:30:22 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Nov 07 02:30:22 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.244s {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:22 devstack cinder-volume[86433]: INFO cinder.volume.manager [None req-000df4fc-dd59-488e-94e2-2b9d113f9a5f None None] Driver post RPC initialization completed successfully.
Nov 07 02:30:26 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-59662c68-5f41-4e3d-9acf-91694ef245e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:30:26 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-59662c68-5f41-4e3d-9acf-91694ef245e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:30:26 devstack cinder-volume[86433]: DEBUG cinder.volume.drivers.quobyte [None req-59662c68-5f41-4e3d-9acf-91694ef245e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=86433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:30:26 devstack cinder-volume[86433]: DEBUG cinder.volume.drivers.quobyte [None req-59662c68-5f41-4e3d-9acf-91694ef245e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=86433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:30:26 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-59662c68-5f41-4e3d-9acf-91694ef245e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:30:26 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-59662c68-5f41-4e3d-9acf-91694ef245e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:26 devstack sudo[86750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:30:26 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:30:26 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Caught SIGTERM, stopping children
Nov 07 02:30:26 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Acquiring lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:30:26 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Acquired lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:30:26 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Releasing lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:30:26 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Stop services. {{(pid=86214) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 07 02:30:26 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Killing children. {{(pid=86214) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 07 02:30:26 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Waiting on 1 children to exit
Nov 07 02:30:27 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root
Nov 07 02:30:27 devstack cinder-volume[86433]: DEBUG oslo_concurrency.processutils [None req-59662c68-5f41-4e3d-9acf-91694ef245e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.394s {{(pid=86433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:27 devstack cinder-volume[86433]: DEBUG cinder.manager [None req-59662c68-5f41-4e3d-9acf-91694ef245e2 None None] Notifying Schedulers of capabilities ... {{(pid=86433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59662c68-5f41-4e3d-9acf-91694ef245e2 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59662c68-5f41-4e3d-9acf-91694ef245e2 None None] Unable to connect to AMQP server on 192.168.122.26:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server [None req-59662c68-5f41-4e3d-9acf-91694ef245e2 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.26:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     method()
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     return _publish(
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     listener(*args)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server 
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server 
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     self.transport._send(
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.26:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 07 02:30:27 devstack cinder-volume[86433]: ERROR oslo_messaging.rpc.server 
Nov 07 02:30:30 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Acquiring lock "singleton_lock" {{(pid=86433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:30:30 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Acquired lock "singleton_lock" {{(pid=86433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:30:30 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Releasing lock "singleton_lock" {{(pid=86433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:30:30 devstack cinder-volume[86433]: WARNING amqp [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 07 02:30:30 devstack cinder-volume[86433]: WARNING amqp [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 07 02:30:30 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-964aa9a5-c024-4682-837f-e64cba976384 None None] Child 86433 exited with status 0
Nov 07 02:30:30 devstack cinder-volume[86789]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 07 02:30:30 devstack cinder-volume[86789]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 07 02:30:30 devstack cinder-volume[86789]: we strongly recommend against using it for new projects.
Nov 07 02:30:30 devstack cinder-volume[86789]: If you are already using Eventlet, we recommend migrating to a different
Nov 07 02:30:30 devstack cinder-volume[86789]: framework.  For more detail see
Nov 07 02:30:30 devstack cinder-volume[86789]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 07 02:30:30 devstack cinder-volume[86789]:   import eventlet  # noqa
Nov 07 02:30:33 devstack cinder-volume[86789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:30:33 devstack cinder-volume[86789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:30:33 devstack cinder-volume[86789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:30:34 devstack cinder-volume[86789]: INFO dbcounter [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Registered counter for database cinder
Nov 07 02:30:34 devstack cinder-volume[86789]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:30:34 devstack cinder-volume[86789]: DEBUG dbcounter [-] [86789] Writer thread running {{(pid=86789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:30:34 devstack cinder-volume[86789]: INFO cinder.rpc [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 07 02:30:34 devstack cinder-volume[86789]: INFO cinder.rpc [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 07 02:30:34 devstack cinder-volume[86789]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:30:34 devstack cinder-volume[86789]: INFO cinder.volume.manager [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Determined volume DB was empty at startup.
Nov 07 02:30:34 devstack cinder-volume[86789]: DEBUG cinder.volume.manager [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86789) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 07 02:30:34 devstack cinder-volume[86789]: WARNING stevedore.named [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 07 02:30:34 devstack cinder-volume[86789]: WARNING castellan.key_manager [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:30:34 devstack cinder-volume[86789]: WARNING cinder.keymgr.conf_key_mgr [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:30:34 devstack cinder-volume[86789]: INFO cinder.volume.manager [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:30:35 devstack cinder-volume[86789]: INFO oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Starting 1 workers
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Started child 87087 {{(pid=86789) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Full set of CONF: {{(pid=86789) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] ******************************************************************************** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] Configuration options gathered from: {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] ================================================================================ {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] allow_availability_zone_fallback = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] allow_compression_on_image_upload = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[87087]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] allowed_direct_url_schemes     = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] api_rate_limit                 = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] auth_strategy                  = keystone {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_availability_zone      = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_host                   = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_name                   = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_stats_polling_interval = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backup_api_class               = cinder.backup.api.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backup_name_template           = backup-%s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backup_use_same_host           = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backup_use_temp_snapshot       = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] chap_password                  = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] chap_username                  =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cinder_internal_tenant_project_id = 3aa211f8cd5042029dcb46ddb1fc309a {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cinder_internal_tenant_user_id = 6d94b31fc82d46848a6763e7979f421e {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cluster                        = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] compression_format             = gzip {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] config_dir                     = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] config_source                  = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] control_exchange               = openstack {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] debug                          = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] default_availability_zone      = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] default_group_type             = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] default_volume_type            = QuobyteHD {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] disk_geometry                  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] driver_client_cert             = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] driver_client_cert_key         = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] driver_data_namespace          = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] driver_ssl_cert_path           = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] driver_ssl_cert_verify         = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] driver_use_ssl                 = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] enable_new_services            = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] enable_unsupported_driver      = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] enforce_multipath_for_image_xfer = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] filter_function                = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance_api_insecure            = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance_api_servers             = ['http://192.168.122.26/image'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance_api_ssl_compression     = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance_ca_certificates_file    = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance_certfile                = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance_keyfile                 = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance_num_retries             = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance_request_timeout         = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] goodness_function              = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] graceful_shutdown_timeout      = 5 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] group_api_class                = cinder.group.api.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] host                           = devstack {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_compress_on_upload       = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_conversion_address_space_limit = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_conversion_cpu_limit     = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_conversion_disable       = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_introspection_address_space_limit = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_introspection_cpu_limit  = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_upload_use_cinder_backend = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_upload_use_internal_tenant = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_volume_cache_enabled     = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_volume_cache_max_count   = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] image_volume_cache_max_size_gb = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] init_host_max_objects_retrieval = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] iscsi_target_flags             =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] iscsi_write_cache              = on {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] iser_helper                    = tgtadm {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] iser_ip_address                = 192.168.122.26 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] iser_port                      = 3260 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] log_color                      = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] log_config_append              = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] log_dir                        = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] log_file                       = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] log_options                    = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] log_rotate_interval            = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] log_rotate_interval_type       = days {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] log_rotation_type              = none {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87087) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] max_age                        = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] max_logfile_count              = 30 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] max_logfile_size_mb            = 200 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] max_over_subscription_ratio    = 20.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] message_reap_interval          = 86400 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] message_ttl                    = 2592000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] migration_create_volume_timeout_secs = 300 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] monkey_patch                   = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] monkey_patch_modules           = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] my_ip                          = 192.168.122.26 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] no_snapshot_gb_quota           = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] num_iser_scan_tries            = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] num_shell_tries                = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] num_volume_device_scan_tries   = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] nvmeof_conn_info_version       = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] nvmet_ns_id                    = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] nvmet_port_id                  = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] osapi_max_limit                = 1000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] osapi_volume_ext_list          = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] osapi_volume_listen_port       = 8776 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] osapi_volume_use_ssl           = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] osapi_volume_workers           = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] per_volume_size_limit          = -1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] periodic_fuzzy_delay           = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] periodic_interval              = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] public_endpoint                = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] publish_errors                 = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] quota_backup_gigabytes         = 1000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] quota_backups                  = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] quota_gigabytes                = 1000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] quota_groups                   = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] quota_snapshots                = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] quota_volumes                  = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] rate_limit_burst               = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] rate_limit_except_level        = CRITICAL {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] rate_limit_interval            = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] reinit_driver_count            = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] replication_device             = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] report_discard_supported       = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] report_interval                = 120 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] reservation_clean_interval     = 86400 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] reservation_expire             = 86400 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] reserved_image_namespaces      = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] reserved_percentage            = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] rpc_response_timeout           = 120 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] run_external_periodic_tasks    = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] scst_target_driver             = iscsi {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] scst_target_iqn_name           = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_down_time              = 720 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] shell_completion               = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] snapshot_name_template         = snapshot-%s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] split_loggers                  = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] state_path                     = /opt/stack/data/cinder {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] storage_availability_zone      = nova {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] storage_protocol               = iSCSI {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] syslog_log_facility            = LOG_USER {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] target_helper                  = lioadm {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] target_ip_address              = 192.168.122.26 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] target_port                    = 3260 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] target_protocol                = iscsi {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] target_secondary_ip_addresses  = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] trace_flags                    = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] transport_url                  = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] until_refresh                  = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] use_chap_auth                  = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] use_default_quota_class        = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] use_journal                    = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] use_json                       = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] use_multipath_for_image_xfer   = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] use_stderr                     = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] use_syslog                     = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] verify_glance_signatures       = enabled {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_api_class               = cinder.volume.api.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_backend_name            = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_clear                   = zero {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_clear_ionice            = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_clear_size              = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_copy_bps_limit          = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_dd_blocksize            = 1M {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_name_template           = volume-%s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_service_inithost_offload = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volume_usage_audit_period      = month {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] zoning_mode                    = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_concurrency.disable_process_locking = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.auth_section = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.auth_type   = password {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.auth_version = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.cache       = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.certfile    = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.include_service_catalog = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.insecure    = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.interface   = public {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.keyfile     = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_password = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcache_username = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.region_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.service_type = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.26/identity {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.backend                  = dogpile.cache.null {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.backend_argument         = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.backend_expiration_time  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.config_prefix            = cache.oslo {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.debug_cache_backend      = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.enable_retry_client      = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.enable_socket_keepalive  = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.enabled                  = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.expiration_time          = 600 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.hashclient_retry_attempts = 2 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.memcache_dead_retry      = 300 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.memcache_sasl_enabled    = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.password                 = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.proxies                  = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.redis_db                 = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87087) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 07 02:30:35 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.quobyte [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.redis_server             = localhost:6379 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.retry_attempts           = 2 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.retry_delay              = 0.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.socket_keepalive_count   = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.socket_keepalive_idle    = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.socket_keepalive_interval = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.socket_timeout           = 1.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.quobyte [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.tls_allowed_ciphers      = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.tls_cafile               = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.tls_certfile             = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Running cmd (subprocess): mount.quobyte {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.tls_enabled              = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.tls_keyfile              = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cache.username                 = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] coordination.backend_url       = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.asyncio_connection    = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.asyncio_slave_connection = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.backend               = sqlalchemy {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.connection            = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.connection_debug      = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.connection_parameters =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.connection_recycle_time = 3600 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.connection_trace      = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.db_inc_retry_interval = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.db_max_retries        = 20 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.db_max_retry_interval = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.db_retry_interval     = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.max_overflow          = 50 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.max_pool_size         = 5 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.max_retries           = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.mysql_wsrep_sync_wait = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.pool_timeout          = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.retry_interval        = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.slave_connection      = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.sqlite_synchronous    = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.synchronous_reader    = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] database.use_db_reconnect      = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_tracing.insecure = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler.connection_string     = messaging:// {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler.enabled               = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler.es_doc_type           = notification {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler.es_scroll_size        = 10000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler.es_scroll_time        = 2m {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler.filter_error_trace    = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler.hmac_keys             = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler.sentinel_service_name = mymaster {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler.socket_timeout        = 0.1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler.trace_requests        = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler.trace_sqlalchemy      = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler_jaeger.process_tags   = {} {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler_jaeger.service_name_prefix = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] profiler_otlp.service_name_prefix = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_policy.enforce_new_defaults = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_policy.policy_default_rule = default {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] privsep_osbrick.group          = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] privsep_osbrick.helper_command = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] privsep_osbrick.user           = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cinder_sys_admin.group         = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cinder_sys_admin.helper_command = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] cinder_sys_admin.user          = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.auth_section      = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.auth_type         = password {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.cafile            = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.certfile          = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.collect_timing    = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.insecure          = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.keyfile           = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.send_service_user_token = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.split_loggers     = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.timeout           = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.tls_ciphers       = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] service_user.tls_min_version   = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.auth_section            = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.auth_type               = password {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.certfile                = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.collect_timing          = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.insecure                = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.keyfile                 = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.region_name             = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.split_loggers           = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.timeout                 = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.tls_ciphers             = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] glance.tls_min_version         = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.backend_availability_zone = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.chap_password = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.chap_username =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.disk_geometry = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.driver_client_cert = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.driver_client_cert_key = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.driver_data_namespace = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.driver_use_ssl = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.extra_capabilities = {} {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.filter_function = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.goodness_function = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.iscsi_target_flags =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.iscsi_write_cache = on {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.iser_ip_address = 192.168.122.26 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.iser_port     = 3260 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nas_host      =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nas_login     = admin {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nas_mount_options = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nas_password  = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nas_private_key =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nas_share_path =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.num_shell_tries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack quobyte-client[87088]: Reading configuration file: /etc/quobyte/client.cfg
Nov 07 02:30:35 devstack quobyte-client[87088]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.quobyte_volume_url = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.replication_device = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.report_discard_supported = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.reserved_percentage = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.target_helper = tgtadm {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.target_ip_address = 192.168.122.26 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.target_port   = 3260 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.target_protocol = iscsi {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.trace_flags   = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.unique_fqdn_network = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.use_chap_auth = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.volume_backend_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.volume_clear  = zero {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.volume_clear_ionice = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.volume_clear_size = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_reports.file_event_handler = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_reports.log_dir           = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.backend_availability_zone = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.backend_host         = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.chap_password        = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.chap_username        = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.disk_geometry        = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.driver_client_cert   = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.driver_data_namespace = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.extra_capabilities   = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.filter_function      = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.goodness_function    = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.iser_helper          = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.iser_ip_address      = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.iser_port            = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nas_host             = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nas_login            = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nas_mount_options    = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nas_password         = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nas_private_key      = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nas_share_path       = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.num_shell_tries      = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.replication_device   = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.report_discard_supported = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.reserved_percentage  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.scst_target_driver   = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.storage_protocol     = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.target_helper        = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.target_ip_address    = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.target_port          = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.target_prefix        = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.target_protocol      = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.trace_flags          = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.use_chap_auth        = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.volume_clear         = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.volume_clear_size    = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] QuobyteHD.volumes_dir          = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack sudo[87098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_notifications.driver = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_notifications.retry = -1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] key_manager.fixed_key          = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.barbican_api_version  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.barbican_endpoint     = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.barbican_endpoint_type = public {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.barbican_region_name  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.cafile                = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.certfile              = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.collect_timing        = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.insecure              = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.keyfile               = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.number_of_retries     = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.retry_delay           = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.send_service_user_token = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.split_loggers         = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.timeout               = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.tls_ciphers           = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.tls_min_version       = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.verify_ssl            = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican.verify_ssl_path       = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican_service_user.auth_section = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican_service_user.auth_type = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican_service_user.cafile   = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican_service_user.certfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican_service_user.collect_timing = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican_service_user.insecure = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican_service_user.keyfile  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican_service_user.split_loggers = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican_service_user.timeout  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican_service_user.tls_ciphers = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] barbican_service_user.tls_min_version = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.approle_role_id          = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.approle_secret_id        = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.auth_method              = approle {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.auth_path                = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.kv_mountpoint            = secret {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.kv_path                  = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.kv_version               = 2 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.namespace                = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.root_token_id            = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.ssl_ca_crt_file          = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.timeout                  = 60.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.token_file               = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.token_role               = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.use_ssl                  = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:30:35 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-9bd3cbf8-0ae6-4aa5-97a7-4343748cf0f7 None None] ******************************************************************************** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 07 02:30:35 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.289s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:35 devstack cinder-volume[87087]: INFO cinder.volume.driver [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Driver hasn't implemented _init_vendor_properties()
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG cinder.volume.driver [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7832832336426, 'free_capacity_gb': 1773.7832832336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87087) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_db.sqlalchemy.engines [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87087) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writer thread running {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG cinder.db.api [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Building query based on filter {{(pid=87087) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87087) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:35 devstack cinder-volume[87087]: INFO cinder.keymgr.migration [None req-db1a7511-0732-4969-842c-08afaa47ab71 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 07 02:30:35 devstack sudo[87108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:30:35 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:30:35 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.237s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:30:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Driver initialization completed successfully.
Nov 07 02:30:35 devstack cinder-volume[87087]: INFO cinder.manager [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Initiating service 3 cleanup
Nov 07 02:30:36 devstack cinder-volume[87087]: INFO cinder.manager [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Service 3 cleanup completed.
Nov 07 02:30:36 devstack cinder-volume[87087]: DEBUG cinder.service [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Creating RPC server for service cinder-volume {{(pid=87087) start /opt/stack/cinder/cinder/service.py:231}}
Nov 07 02:30:36 devstack cinder-volume[87087]: DEBUG cinder.service [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87087) start /opt/stack/cinder/cinder/service.py:237}}
Nov 07 02:30:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 07 02:30:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:30:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:30:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:30:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:30:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:30:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:36 devstack sudo[87116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:30:36 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:30:36 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root
Nov 07 02:30:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.261s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-758b0082-0917-4afb-8ec3-3c326520cb1a None None] Driver post RPC initialization completed successfully.
Nov 07 02:30:45 devstack cinder-volume[86789]: DEBUG dbcounter [-] [86789] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:30:46 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:30:46 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:30:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:30:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 6 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:30:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:31:34 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Flow 'volume_create_manager' (ecfe9d67-a92e-418d-b07f-bc4be3dc6df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fd1c93-581a-4462-b1e5-6b1e1e816791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fd1c93-581a-4462-b1e5-6b1e1e816791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-78154945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d070fe40-63f4-4fa1-8822-a731b8bf4216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad96ff13f5d41bdb8a8dc08ce8c646e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:35Z,use_quota=True,user_id='44b0be12a7ba492c856b691dc5774204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8b5ce0-4708-4309-884d-a4f8d78abf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8b5ce0-4708-4309-884d-a4f8d78abf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4ef49a-59cf-4c24-b666-0806b518f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4ef49a-59cf-4c24-b666-0806b518f867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd070fe40-63f4-4fa1-8822-a731b8bf4216', 'volume_name': 'volume-d070fe40-63f4-4fa1-8822-a731b8bf4216', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af3d78b-ee21-4171-a3ce-4369550041da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af3d78b-ee21-4171-a3ce-4369550041da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0199037-ad70-4bfd-baac-85993c0fd847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Volume d070fe40-63f4-4fa1-8822-a731b8bf4216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d070fe40-63f4-4fa1-8822-a731b8bf4216', 'volume_size': 1}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-78154945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d070fe40-63f4-4fa1-8822-a731b8bf4216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad96ff13f5d41bdb8a8dc08ce8c646e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:35Z,use_quota=True,user_id='44b0be12a7ba492c856b691dc5774204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Creating volume d070fe40-63f4-4fa1-8822-a731b8bf4216 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:31:35 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:35 devstack sudo[87624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216 1073741824
Nov 07 02:31:35 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Flow 'volume_create_manager' (3b781d24-e488-4072-94e2-a55836df52f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4894e5f2-833e-44c4-bee7-e6d9dfae5ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4894e5f2-833e-44c4-bee7-e6d9dfae5ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-873460732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0112e6-87d4-41a0-89f5-34e83e75334e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81eebe567cec47c5a7e2ab98d01eb58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:35Z,use_quota=True,user_id='846f2faed83e4bf2a35f681cd94624c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6ea62b-e697-4deb-a12b-ccc327a497bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6ea62b-e697-4deb-a12b-ccc327a497bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508fea0f-fa65-418a-b87f-91f8b8fbe943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508fea0f-fa65-418a-b87f-91f8b8fbe943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b0112e6-87d4-41a0-89f5-34e83e75334e', 'volume_name': 'volume-2b0112e6-87d4-41a0-89f5-34e83e75334e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c45d2e-9a09-43ed-a707-7134f09a0ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c45d2e-9a09-43ed-a707-7134f09a0ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f2f1f5-8bf8-48d6-8e21-4cb823ef8655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Volume 2b0112e6-87d4-41a0-89f5-34e83e75334e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b0112e6-87d4-41a0-89f5-34e83e75334e', 'volume_size': 1}
Nov 07 02:31:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:36 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216 1073741824" returned: 0 in 0.915s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:36 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216
Nov 07 02:31:36 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:36 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216" returned: 0 in 0.543s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.261s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-873460732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0112e6-87d4-41a0-89f5-34e83e75334e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81eebe567cec47c5a7e2ab98d01eb58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:35Z,use_quota=True,user_id='846f2faed83e4bf2a35f681cd94624c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Creating volume 2b0112e6-87d4-41a0-89f5-34e83e75334e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:31:36 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:36 devstack sudo[87980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e 1073741824
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0199037-ad70-4bfd-baac-85993c0fd847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d070fe40-63f4-4fa1-8822-a731b8bf4216', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:36 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c19b96c-e58f-40e5-8cb0-007c581e530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Volume volume-d070fe40-63f4-4fa1-8822-a731b8bf4216 (d070fe40-63f4-4fa1-8822-a731b8bf4216): created successfully
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c19b96c-e58f-40e5-8cb0-007c581e530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Flow 'volume_create_manager' (ecfe9d67-a92e-418d-b07f-bc4be3dc6df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c2f76e40-0e8c-45dc-9ed8-ee6c75226694 tempest-DeleteServersTestJSON-1015001464 None] Created volume successfully.
Nov 07 02:31:37 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e 1073741824" returned: 0 in 0.639s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:37 devstack sudo[87989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e
Nov 07 02:31:37 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:37 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e" returned: 0 in 0.291s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:31:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f2f1f5-8bf8-48d6-8e21-4cb823ef8655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b0112e6-87d4-41a0-89f5-34e83e75334e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7307951-4fd8-4245-ad85-4fea989bf8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Volume volume-2b0112e6-87d4-41a0-89f5-34e83e75334e (2b0112e6-87d4-41a0-89f5-34e83e75334e): created successfully
Nov 07 02:31:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7307951-4fd8-4245-ad85-4fea989bf8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Flow 'volume_create_manager' (3b781d24-e488-4072-94e2-a55836df52f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-76a7de8e-0eab-40a2-81a7-626e007de56f req-cab0eb9a-993c-4399-93de-ea74cedab9bb tempest-VolumesGetTestJSON-262711169 None] Created volume successfully.
Nov 07 02:31:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Acquiring lock "cinder-2b0112e6-87d4-41a0-89f5-34e83e75334e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Lock "cinder-2b0112e6-87d4-41a0-89f5-34e83e75334e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Acquiring lock "cinder-quobyte-2b0112e6-87d4-41a0-89f5-34e83e75334e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Lock "cinder-quobyte-2b0112e6-87d4-41a0-89f5-34e83e75334e" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:39 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6uh49zms/privsep.sock']
Nov 07 02:31:39 devstack sudo[88020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6uh49zms/privsep.sock
Nov 07 02:31:39 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:40 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 07 02:31:40 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 07 02:31:40 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 07 02:31:40 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 07 02:31:40 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 07 02:31:40 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 07 02:31:40 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 07 02:31:40 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 07 02:31:40 devstack cinder-volume[87087]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 07 02:31:40 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:40 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Spawned new privsep daemon via rootwrap
Nov 07 02:31:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Accepted privsep connection to /tmp/tmp6uh49zms/privsep.sock {{(pid=87087) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 07 02:31:40 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 07 02:31:40 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 07 02:31:40 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 07 02:31:40 devstack cinder-volume[87087]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88045
Nov 07 02:31:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[566ae577-c2a8-454d-8a87-c613fe5e3166]: (2,) {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:31:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[926b5d83-2921-496f-a289-e8a7442ada48]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:31:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:41 devstack sudo[88052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e
Nov 07 02:31:41 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:41 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e" returned: 0 in 0.526s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:41 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e
Nov 07 02:31:41 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:41 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b0112e6-87d4-41a0-89f5-34e83e75334e" returned: 0 in 0.264s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Lock "cinder-quobyte-2b0112e6-87d4-41a0-89f5-34e83e75334e" released by "delete_volume" :: held 2.414s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:41 devstack cinder-volume[87087]: WARNING cinder.quota [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:31:41 devstack cinder-volume[87087]: WARNING cinder.quota [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:31:41 devstack cinder-volume[87087]: DEBUG cinder.quota [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Created reservations ['afa1b585-6909-4e32-b9c4-fa3a931822fd', '7689b59c-3149-4b25-88b9-8d134e587fe2', 'b9354097-1cd1-42a1-8918-a40e76de6189', '09996b14-ab28-4a12-8dc5-c76c791622ab'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:31:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:42 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:31:42 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:42 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.356s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:42 devstack cinder-volume[87087]: DEBUG cinder.manager [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:31:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Deleted volume successfully.
Nov 07 02:31:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b22f0ad3-9cfa-4e56-beda-3e63a622dfed req-bc5661f6-4628-44ee-98c4-6bc2dc204d98 tempest-VolumesGetTestJSON-262711169 None] Lock "cinder-2b0112e6-87d4-41a0-89f5-34e83e75334e-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:42 devstack cinder-volume[87087]: WARNING py.warnings [req-5b34c3bf-ae95-46d1-ba76-18c052c3fadd req-a4d0cc52-32a5-457b-8a73-b0cd547fd534 tempest-DeleteServersTestJSON-1015001464 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Nov 07 02:31:42 devstack cinder-volume[87087]:   .first()
Nov 07 02:31:42 devstack cinder-volume[87087]: 
Nov 07 02:31:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-5b34c3bf-ae95-46d1-ba76-18c052c3fadd req-a4d0cc52-32a5-457b-8a73-b0cd547fd534 tempest-DeleteServersTestJSON-1015001464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-5b34c3bf-ae95-46d1-ba76-18c052c3fadd req-a4d0cc52-32a5-457b-8a73-b0cd547fd534 tempest-DeleteServersTestJSON-1015001464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-5b34c3bf-ae95-46d1-ba76-18c052c3fadd req-a4d0cc52-32a5-457b-8a73-b0cd547fd534 tempest-DeleteServersTestJSON-1015001464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-5b34c3bf-ae95-46d1-ba76-18c052c3fadd req-a4d0cc52-32a5-457b-8a73-b0cd547fd534 tempest-DeleteServersTestJSON-1015001464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-d070fe40-63f4-4fa1-8822-a731b8bf4216', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b77cdf2-d2e9-4a0c-b7a0-61a838998ed8', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:31:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-5b34c3bf-ae95-46d1-ba76-18c052c3fadd req-a4d0cc52-32a5-457b-8a73-b0cd547fd534 tempest-DeleteServersTestJSON-1015001464 None] attachment_update completed successfully.
Nov 07 02:31:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-a11ca92e-dcac-4b9f-a775-259d4c54a057 req-c6437f6f-fbc5-40eb-aa05-40c762ed91b9 tempest-DeleteServersTestJSON-1015001464 None] Terminate volume connection completed successfully.
Nov 07 02:31:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-a11ca92e-dcac-4b9f-a775-259d4c54a057 req-c6437f6f-fbc5-40eb-aa05-40c762ed91b9 tempest-DeleteServersTestJSON-1015001464 None] Deleting attachment 8b77cdf2-d2e9-4a0c-b7a0-61a838998ed8. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:31:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Acquiring lock "cinder-d070fe40-63f4-4fa1-8822-a731b8bf4216-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Lock "cinder-d070fe40-63f4-4fa1-8822-a731b8bf4216-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Acquiring lock "cinder-quobyte-d070fe40-63f4-4fa1-8822-a731b8bf4216" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Lock "cinder-quobyte-d070fe40-63f4-4fa1-8822-a731b8bf4216" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbde448b-bbdb-4f91-adbb-2f57561c9d46]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:31:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:50 devstack sudo[88669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216
Nov 07 02:31:50 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:50 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216" returned: 0 in 0.461s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:50 devstack sudo[88674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216
Nov 07 02:31:50 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:51 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d070fe40-63f4-4fa1-8822-a731b8bf4216" returned: 0 in 0.304s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Lock "cinder-quobyte-d070fe40-63f4-4fa1-8822-a731b8bf4216" released by "delete_volume" :: held 0.826s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Created reservations ['09c83db5-0713-4c2c-9087-fd9d932f062f', 'ac128d08-790d-4a55-8170-90bb95477424', '709ac52c-0b46-4e89-91f7-2d26ad0985fe', '438f9a91-0136-4f5a-9cdf-4ecc31a5519b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:51 devstack sudo[88680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:31:51 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:51 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.424s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:31:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Deleted volume successfully.
Nov 07 02:31:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0b6512ff-83f9-4a6b-9a10-db6ae98e5579 tempest-DeleteServersTestJSON-1015001464 None] Lock "cinder-d070fe40-63f4-4fa1-8822-a731b8bf4216-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:53 devstack sudo[88684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:31:53 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:53 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.561s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 8 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:31:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Flow 'volume_create_manager' (be787b10-15eb-40cd-bbb4-1e19b20f7284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9833e3dc-4322-478a-925d-73c9d8123bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9833e3dc-4322-478a-925d-73c9d8123bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-169132666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6355e8a-717a-4853-97d4-3fc817f385bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffee6a474346484586a03ec7cb6775ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:57Z,use_quota=True,user_id='fece4f2a94b6491293cc28a016978d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86821300-9f79-4833-a87a-d183d5d9ce2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86821300-9f79-4833-a87a-d183d5d9ce2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9587ee-b9fe-44cd-90e4-abcbde1f3175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9587ee-b9fe-44cd-90e4-abcbde1f3175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6355e8a-717a-4853-97d4-3fc817f385bc', 'volume_name': 'volume-f6355e8a-717a-4853-97d4-3fc817f385bc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4c5549-c47a-4909-9181-81885cb99b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4c5549-c47a-4909-9181-81885cb99b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87e272c-9da5-40c6-a84f-4a7831c4e3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Volume f6355e8a-717a-4853-97d4-3fc817f385bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6355e8a-717a-4853-97d4-3fc817f385bc', 'volume_size': 1}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-169132666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6355e8a-717a-4853-97d4-3fc817f385bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffee6a474346484586a03ec7cb6775ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:57Z,use_quota=True,user_id='fece4f2a94b6491293cc28a016978d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Creating volume f6355e8a-717a-4853-97d4-3fc817f385bc {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:31:56 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:31:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:56 devstack sudo[88689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc 1073741824
Nov 07 02:31:56 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1abbfb97-7222-4017-b7cf-92a074268e44 tempest-GroupSnapshotsTest-357169460 None] Group tempest-GroupSnapshotsTest-Group-520033508: creating
Nov 07 02:31:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1abbfb97-7222-4017-b7cf-92a074268e44 tempest-GroupSnapshotsTest-357169460 None] Group tempest-GroupSnapshotsTest-Group-520033508: created successfully
Nov 07 02:31:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1abbfb97-7222-4017-b7cf-92a074268e44 tempest-GroupSnapshotsTest-357169460 None] Create group completed successfully.
Nov 07 02:31:57 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc 1073741824" returned: 0 in 0.591s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:57 devstack sudo[88697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc
Nov 07 02:31:57 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:57 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc" returned: 0 in 0.348s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:31:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87e272c-9da5-40c6-a84f-4a7831c4e3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6355e8a-717a-4853-97d4-3fc817f385bc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c35813-24e5-4ed2-b72b-e7d4d9d4cd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Volume volume-f6355e8a-717a-4853-97d4-3fc817f385bc (f6355e8a-717a-4853-97d4-3fc817f385bc): created successfully
Nov 07 02:31:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c35813-24e5-4ed2-b72b-e7d4d9d4cd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Flow 'volume_create_manager' (be787b10-15eb-40cd-bbb4-1e19b20f7284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3898a9b0-a59f-40ef-9491-ae4253d97973 tempest-VolumesAdminNegativeTest-1650882077 None] Created volume successfully.
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Flow 'volume_create_manager' (94b7e8c5-7511-4e05-afb0-630868f6f1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44599e3f-5269-4cb5-9cf8-8be8341a080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44599e3f-5269-4cb5-9cf8-8be8341a080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1478166154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=efc95829-185b-4de2-9f8b-dc704d856d20,host='devstack@QuobyteHD#QuobyteHD',id=c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113f1377b49449d7b698b69bb14f556f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:00Z,use_quota=True,user_id='c2c0b99416f6498594986a50ab7f6089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f47d5839-b108-49cd-a2b1-c5fa48a8407d),volume_type_id=f47d5839-b108-49cd-a2b1-c5fa48a8407d)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd9c022-420a-4a86-8486-dc556b605e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd9c022-420a-4a86-8486-dc556b605e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ca86c4-6e74-4bdf-8d4f-a76126bed78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ca86c4-6e74-4bdf-8d4f-a76126bed78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8', 'volume_name': 'volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf873d9e-68a7-4fa9-83e9-e0df485bfe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf873d9e-68a7-4fa9-83e9-e0df485bfe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fe5827-3948-4379-b2f3-e1feaed54240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Volume c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8', 'volume_size': 1}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=efc95829-185b-4de2-9f8b-dc704d856d20,created_at=2026-11-07T01:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1478166154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=efc95829-185b-4de2-9f8b-dc704d856d20,host='devstack@QuobyteHD#QuobyteHD',id=c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113f1377b49449d7b698b69bb14f556f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:00Z,use_quota=True,user_id='c2c0b99416f6498594986a50ab7f6089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f47d5839-b108-49cd-a2b1-c5fa48a8407d),volume_type_id=f47d5839-b108-49cd-a2b1-c5fa48a8407d)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Creating volume c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:31:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:31:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:59 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 1073741824
Nov 07 02:31:59 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Acquiring lock "cinder-f6355e8a-717a-4853-97d4-3fc817f385bc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Lock "cinder-f6355e8a-717a-4853-97d4-3fc817f385bc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Acquiring lock "cinder-quobyte-f6355e8a-717a-4853-97d4-3fc817f385bc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Lock "cinder-quobyte-f6355e8a-717a-4853-97d4-3fc817f385bc" acquired by "delete_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f1c710-065d-488a-a2ce-c0dc0950ad39]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:00 devstack sudo[88706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc
Nov 07 02:32:00 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:00 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 1073741824" returned: 0 in 0.880s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:00 devstack sudo[88712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8
Nov 07 02:32:00 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:01 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc" returned: 0 in 0.689s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:01 devstack sudo[88717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc
Nov 07 02:32:01 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:01 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" returned: 0 in 0.429s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fe5827-3948-4379-b2f3-e1feaed54240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6793c6-42bb-4bc1-8269-3c3375e0c7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:01 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Volume volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 (c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8): created successfully
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6793c6-42bb-4bc1-8269-3c3375e0c7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Flow 'volume_create_manager' (94b7e8c5-7511-4e05-afb0-630868f6f1a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:32:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5447f36e-7b89-4d8f-a258-5f782523c037 tempest-GroupSnapshotsTest-357169460 None] Created volume successfully.
Nov 07 02:32:01 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f6355e8a-717a-4853-97d4-3fc817f385bc" returned: 0 in 0.488s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Lock "cinder-quobyte-f6355e8a-717a-4853-97d4-3fc817f385bc" released by "delete_volume" :: held 1.256s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Created reservations ['324a9206-d9bb-4446-b6f2-9ec853815f68', 'a1451541-ee4b-4118-aea9-964dee4ac595', '82c2d891-54d8-47b2-b0b0-722a573e51fb', 'b84e3d01-5cfe-4b1d-bd09-6f64b53953c1'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:01 devstack sudo[88721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:32:01 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:02 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.303s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:02 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:32:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Deleted volume successfully.
Nov 07 02:32:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-55a19a69-05dd-4f1d-8534-e705858cb619 tempest-VolumesAdminNegativeTest-1650882077 None] Lock "cinder-f6355e8a-717a-4853-97d4-3fc817f385bc-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] GroupSnapshot 8d62575e-0d24-4039-ac26-8974347dc6c1: creating.
Nov 07 02:32:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] Group snapshot 8d62575e-0d24-4039-ac26-8974347dc6c1: creating. {{(pid=87087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 07 02:32:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] Creating offline snapshot 2b9ba328-4279-42a9-972d-34290e54e363 of volume c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:32:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[943a8766-3e3b-4f7a-a450-1a5b890249df]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:03 devstack sudo[88735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8
Nov 07 02:32:03 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:03 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" returned: 0 in 0.557s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:03 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363 1G
Nov 07 02:32:03 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:04 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363 1G" returned: 0 in 0.523s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:04 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363
Nov 07 02:32:04 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:04 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363" returned: 0 in 0.379s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:04 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363 is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:32:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:04 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363
Nov 07 02:32:04 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:05 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363" returned: 0 in 0.313s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:05 devstack sudo[88769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.info
Nov 07 02:32:05 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:05 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.info" returned: 0 in 0.321s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:05 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:32:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:05 devstack sudo[88773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.info
Nov 07 02:32:05 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:05 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.info" returned: 0 in 0.342s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.582s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6134919e-e40b-4eae-80bf-fe3eeff22115 tempest-GroupSnapshotsTest-357169460 None] group_snapshot 8d62575e-0d24-4039-ac26-8974347dc6c1: created successfully
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-2b9ba328-4279-42a9-972d-34290e54e363-b458c9e6-ad85-4ba6-977d-957dd52991a3" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-2b9ba328-4279-42a9-972d-34290e54e363-b458c9e6-ad85-4ba6-977d-957dd52991a3" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Creating volume b458c9e6-ad85-4ba6-977d-957dd52991a3 from snapshot 2b9ba328-4279-42a9-972d-34290e54e363 {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-b458c9e6-ad85-4ba6-977d-957dd52991a3" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-b458c9e6-ad85-4ba6-977d-957dd52991a3" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] snapshot: 2b9ba328-4279-42a9-972d-34290e54e363, volume: b458c9e6-ad85-4ba6-977d-957dd52991a3,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[83453708-0ec6-4db9-bfde-832ffe6e6395]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:07 devstack sudo[88778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363
Nov 07 02:32:07 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:08 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363" returned: 0 in 0.402s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:32:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d01376-a673-4925-b6b3-4b05d717ad4a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:08 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8
Nov 07 02:32:08 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:08 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" returned: 0 in 0.439s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:32:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:32:08 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:32:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:08 devstack sudo[88794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3
Nov 07 02:32:08 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:17 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=43,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=6 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:32:17 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=38,cinder:UPDATE=46,cinder:DELETE=1,cinder:INSERT=10 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:32:17 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3" returned: 0 in 9.138s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:17 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8, size 1024.00 MB, duration 9.14 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:32:17 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Converted 1024.00 MB image at 112.05 MB/s
Nov 07 02:32:17 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3 is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:32:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:17 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3
Nov 07 02:32:17 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:17 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3" returned: 0 in 0.260s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-b458c9e6-ad85-4ba6-977d-957dd52991a3" released by "_copy_volume_from_snapshot" :: held 10.376s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-2b9ba328-4279-42a9-972d-34290e54e363-b458c9e6-ad85-4ba6-977d-957dd52991a3" released by "_create_volume_from_snapshot" :: held 10.460s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.480s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7b4047e3-66b0-48f2-987f-3af33df62988 tempest-GroupSnapshotsTest-357169460 None] Create group from source-snapshot-8d62575e-0d24-4039-ac26-8974347dc6c1 completed successfully.
Nov 07 02:32:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-b458c9e6-ad85-4ba6-977d-957dd52991a3" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-b458c9e6-ad85-4ba6-977d-957dd52991a3" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[facd619a-2e95-4a8f-9985-f42f0e0c0227]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:19 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3
Nov 07 02:32:19 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:20 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3" returned: 0 in 0.451s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:20 devstack sudo[88832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3
Nov 07 02:32:20 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:20 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b458c9e6-ad85-4ba6-977d-957dd52991a3" returned: 0 in 0.263s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-b458c9e6-ad85-4ba6-977d-957dd52991a3" released by "delete_volume" :: held 0.779s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Created reservations ['9a9d82bb-0e9b-414f-bb75-894aa53bdf3c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:20 devstack cinder-volume[87087]: WARNING cinder.quota [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1081874330 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1081874330, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:32:20 devstack cinder-volume[87087]: WARNING cinder.quota [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1081874330 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1081874330, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Created reservations ['6e51b309-2a04-4632-a782-ab3c6a883dbf', '80d312fd-3bed-4659-a10b-a19bc0d3442d', '049fbab2-205f-484f-b12f-dfb3867718d7', '11562e68-43c3-411e-8ffb-191d7ccebe25'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:20 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:32:20 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] group_snapshot 8d62575e-0d24-4039-ac26-8974347dc6c1: deleting
Nov 07 02:32:21 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:32:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ed9720d8-0123-4485-aafa-c418a6e5f417 tempest-GroupSnapshotsTest-357169460 None] Delete group completed successfully.
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] group_snapshot 8d62575e-0d24-4039-ac26-8974347dc6c1: deleting {{(pid=87087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-2b9ba328-4279-42a9-972d-34290e54e363" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-2b9ba328-4279-42a9-972d-34290e54e363" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Deleting offline snapshot 2b9ba328-4279-42a9-972d-34290e54e363 of volume c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] snapshot_file for this snap is: volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3d2f12-31e3-4eb3-88dd-9edda18e1512]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:21 devstack sudo[88838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363
Nov 07 02:32:21 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:21 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363" returned: 0 in 0.500s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b05f75-808d-4208-a9f3-89ee712f0c81]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:21 devstack sudo[88843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8
Nov 07 02:32:21 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:22 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" returned: 0 in 0.590s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:22 devstack sudo[88849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363
Nov 07 02:32:22 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:23 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363" returned: 0 in 0.556s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:23 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363
Nov 07 02:32:23 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:23 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8.2b9ba328-4279-42a9-972d-34290e54e363" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-2b9ba328-4279-42a9-972d-34290e54e363" released by "_delete_snapshot" :: held 2.203s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" released by "delete_snapshot" :: held 2.238s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:23 devstack cinder-volume[87087]: WARNING cinder.quota [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1081874330 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1081874330, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:32:23 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] Created reservations ['ffd25b88-4d4c-4a73-9a0a-ffbadefad0e6', 'ea50b9ba-61de-44c4-84af-86970247c482', 'a9c6e90d-503a-47c9-ae33-e59b8c358c5d', 'ee9ef126-51eb-4d0f-b921-059bde8e733b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2960e918-c6e0-45bc-a544-79db7c3c1058 tempest-GroupSnapshotsTest-357169460 None] group_snapshot 8d62575e-0d24-4039-ac26-8974347dc6c1: deleted successfully
Nov 07 02:32:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3933083-3e8a-4e94-8226-33e29edf78fd]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:25 devstack sudo[88882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8
Nov 07 02:32:25 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:25 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" returned: 0 in 0.435s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:25 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8
Nov 07 02:32:25 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:25 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" returned: 0 in 0.268s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-c6b87ebe-b28b-4f19-8eea-ffddb33f1fa8" released by "delete_volume" :: held 0.804s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:25 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Created reservations ['ab87301b-80b9-4563-9da9-ebb3c238d870'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:26 devstack cinder-volume[87087]: WARNING cinder.db.api [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1081874330']
Nov 07 02:32:26 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Created reservations ['a9a4dff2-330a-4cb5-8a66-d790fc6a4a14', 'a907abff-c2e3-4c5b-999e-f0b339d7028a', 'c4d50376-fb33-4b8e-bc5a-d813d7859d84', '51fc73ab-a14c-4bef-aae3-35978064908c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:26 devstack sudo[88891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:32:26 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:26 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.377s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:26 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:32:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1c6ac376-2b1e-4d7f-bc46-4ffedfb52c98 tempest-GroupSnapshotsTest-357169460 None] Delete group completed successfully.
Nov 07 02:32:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4a275f1f-2ea7-49fd-9cb5-7c930940ed20 tempest-GroupSnapshotsTest-357169460 None] Group tempest-GroupSnapshotsTest-Group-1170456086: creating
Nov 07 02:32:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4a275f1f-2ea7-49fd-9cb5-7c930940ed20 tempest-GroupSnapshotsTest-357169460 None] Group tempest-GroupSnapshotsTest-Group-1170456086: created successfully
Nov 07 02:32:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4a275f1f-2ea7-49fd-9cb5-7c930940ed20 tempest-GroupSnapshotsTest-357169460 None] Create group completed successfully.
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Flow 'volume_create_manager' (69a2fcca-ea73-4b5d-9035-33014ffb5e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51af97b-4ac2-4074-81fd-19881e4f9019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51af97b-4ac2-4074-81fd-19881e4f9019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-579447606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1de9e7c-f87a-4b54-ae61-4018f940c4c1,host='devstack@QuobyteHD#QuobyteHD',id=ac17f6e1-4bed-463b-af85-2f8bf8540438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113f1377b49449d7b698b69bb14f556f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:29Z,use_quota=True,user_id='c2c0b99416f6498594986a50ab7f6089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98c2c6f9-207d-49fd-86bd-439ee890b470),volume_type_id=98c2c6f9-207d-49fd-86bd-439ee890b470)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e4b342-108c-4bda-9c9d-cb09ec0d9b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e4b342-108c-4bda-9c9d-cb09ec0d9b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe143f75-91e0-4a68-9b0e-c007f843d486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe143f75-91e0-4a68-9b0e-c007f843d486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac17f6e1-4bed-463b-af85-2f8bf8540438', 'volume_name': 'volume-ac17f6e1-4bed-463b-af85-2f8bf8540438', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e4d760-ae00-4a9e-9c3d-d888b0c10e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e4d760-ae00-4a9e-9c3d-d888b0c10e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c169606-4360-4382-a36b-82c0a1d334a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Volume ac17f6e1-4bed-463b-af85-2f8bf8540438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac17f6e1-4bed-463b-af85-2f8bf8540438', 'volume_size': 1}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a1de9e7c-f87a-4b54-ae61-4018f940c4c1,created_at=2026-11-07T01:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-579447606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1de9e7c-f87a-4b54-ae61-4018f940c4c1,host='devstack@QuobyteHD#QuobyteHD',id=ac17f6e1-4bed-463b-af85-2f8bf8540438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113f1377b49449d7b698b69bb14f556f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:29Z,use_quota=True,user_id='c2c0b99416f6498594986a50ab7f6089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98c2c6f9-207d-49fd-86bd-439ee890b470),volume_type_id=98c2c6f9-207d-49fd-86bd-439ee890b470)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Creating volume ac17f6e1-4bed-463b-af85-2f8bf8540438 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:32:28 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:32:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:28 devstack sudo[88934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 1073741824
Nov 07 02:32:28 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:29 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 1073741824" returned: 0 in 0.528s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:29 devstack sudo[88940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438
Nov 07 02:32:29 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:29 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438" returned: 0 in 0.313s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:32:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c169606-4360-4382-a36b-82c0a1d334a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac17f6e1-4bed-463b-af85-2f8bf8540438', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7985c3-8ce1-4f3e-966a-55b5b8604519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Volume volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 (ac17f6e1-4bed-463b-af85-2f8bf8540438): created successfully
Nov 07 02:32:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7985c3-8ce1-4f3e-966a-55b5b8604519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Flow 'volume_create_manager' (69a2fcca-ea73-4b5d-9035-33014ffb5e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:32:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-bd1e3f0f-b9b6-4054-b714-3a4c6f58b4e6 tempest-GroupSnapshotsTest-357169460 None] Created volume successfully.
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Flow 'volume_create_manager' (4dd7ec54-c9a2-401e-8394-4d32c9c162da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f852fb64-d21a-4b99-8ca0-5869a46503ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f852fb64-d21a-4b99-8ca0-5869a46503ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1578192652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1de9e7c-f87a-4b54-ae61-4018f940c4c1,host='devstack@QuobyteHD#QuobyteHD',id=4479b41d-29db-4268-bbdf-3ac1c581df6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113f1377b49449d7b698b69bb14f556f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:32Z,use_quota=True,user_id='c2c0b99416f6498594986a50ab7f6089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98c2c6f9-207d-49fd-86bd-439ee890b470),volume_type_id=98c2c6f9-207d-49fd-86bd-439ee890b470)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff06647-d262-4ff7-875a-24d950821b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff06647-d262-4ff7-875a-24d950821b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a681873-deaa-42b3-a9a4-3978e6d3ff12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a681873-deaa-42b3-a9a4-3978e6d3ff12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4479b41d-29db-4268-bbdf-3ac1c581df6f', 'volume_name': 'volume-4479b41d-29db-4268-bbdf-3ac1c581df6f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0025100-1078-41df-a079-2533677a483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0025100-1078-41df-a079-2533677a483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5777dd3-05dc-44ce-a493-00ddee7eebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:31 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Volume 4479b41d-29db-4268-bbdf-3ac1c581df6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4479b41d-29db-4268-bbdf-3ac1c581df6f', 'volume_size': 1}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a1de9e7c-f87a-4b54-ae61-4018f940c4c1,created_at=2026-11-07T01:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1578192652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1de9e7c-f87a-4b54-ae61-4018f940c4c1,host='devstack@QuobyteHD#QuobyteHD',id=4479b41d-29db-4268-bbdf-3ac1c581df6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113f1377b49449d7b698b69bb14f556f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:32Z,use_quota=True,user_id='c2c0b99416f6498594986a50ab7f6089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98c2c6f9-207d-49fd-86bd-439ee890b470),volume_type_id=98c2c6f9-207d-49fd-86bd-439ee890b470)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Creating volume 4479b41d-29db-4268-bbdf-3ac1c581df6f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:32:31 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:32:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:32 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f 1073741824
Nov 07 02:32:32 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:32 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f 1073741824" returned: 0 in 0.506s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:32 devstack sudo[88954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f
Nov 07 02:32:32 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:32 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f" returned: 0 in 0.360s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:32:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5777dd3-05dc-44ce-a493-00ddee7eebfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4479b41d-29db-4268-bbdf-3ac1c581df6f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3c03f2-36ab-4eb3-934e-c1d3f6c70904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Volume volume-4479b41d-29db-4268-bbdf-3ac1c581df6f (4479b41d-29db-4268-bbdf-3ac1c581df6f): created successfully
Nov 07 02:32:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3c03f2-36ab-4eb3-934e-c1d3f6c70904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Flow 'volume_create_manager' (4dd7ec54-c9a2-401e-8394-4d32c9c162da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:32:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a222f200-48ad-44a9-b786-1230500a5325 tempest-GroupSnapshotsTest-357169460 None] Created volume successfully.
Nov 07 02:32:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-42bfe3ae-ef82-440f-bf04-a2d8224d5208 tempest-GroupSnapshotsTest-357169460 None] Update group completed successfully.
Nov 07 02:32:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d3b5bccd-f7d8-4040-a989-1e035fe41a21 tempest-GroupSnapshotsTest-357169460 None] Update group completed successfully.
Nov 07 02:32:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-49131d4f-4a89-47ce-b15d-05717e955181 tempest-GroupSnapshotsTest-357169460 None] Update group completed successfully.
Nov 07 02:32:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ca85b317-1622-4a9a-8105-fcb3cc1ae643 tempest-GroupSnapshotsTest-357169460 None] Update group completed successfully.
Nov 07 02:32:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] GroupSnapshot 84d334ed-bdbd-4403-a6c3-f5c99c09efcc: creating.
Nov 07 02:32:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Group snapshot 84d334ed-bdbd-4403-a6c3-f5c99c09efcc: creating. {{(pid=87087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 07 02:32:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Creating offline snapshot 9a289f5b-ec89-498f-b824-7d9967c6ea76 of volume ac17f6e1-4bed-463b-af85-2f8bf8540438 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:32:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c263734-1bfe-41ac-9484-9721eea88b01]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:39 devstack sudo[89031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438
Nov 07 02:32:39 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:39 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438" returned: 0 in 0.589s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:39 devstack sudo[89036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76 1G
Nov 07 02:32:39 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:40 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76 1G" returned: 0 in 0.611s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:40 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76
Nov 07 02:32:40 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:40 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76" returned: 0 in 0.359s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:40 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76 is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:32:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:40 devstack sudo[89048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76
Nov 07 02:32:40 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:41 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:41 devstack sudo[89051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.info
Nov 07 02:32:41 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:41 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.info" returned: 0 in 0.475s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:41 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:32:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:41 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.info
Nov 07 02:32:41 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:42 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.info" returned: 0 in 0.402s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.986s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Creating offline snapshot b982b1c6-3752-4020-897d-f3d260fabcf2 of volume 4479b41d-29db-4268-bbdf-3ac1c581df6f {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:32:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d259e84e-b1df-4c83-ada3-d1836e94d920]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:42 devstack sudo[89057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f
Nov 07 02:32:42 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:43 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f" returned: 0 in 0.693s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:43 devstack sudo[89067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2 1G
Nov 07 02:32:43 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:44 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2 1G" returned: 0 in 1.238s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4479b41d-29db-4268-bbdf-3ac1c581df6f -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:44 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4479b41d-29db-4268-bbdf-3ac1c581df6f -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2
Nov 07 02:32:44 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:44 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4479b41d-29db-4268-bbdf-3ac1c581df6f -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2" returned: 0 in 0.421s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:44 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2 is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:32:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:44 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2
Nov 07 02:32:44 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:45 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2" returned: 0 in 0.430s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:45 devstack sudo[89091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.info
Nov 07 02:32:45 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:45 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.info" returned: 0 in 0.420s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:45 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:32:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:45 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.info
Nov 07 02:32:45 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:46 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.info" returned: 0 in 0.522s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.913s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e4e96336-2d9f-4d0a-a494-09dc90c2723f tempest-GroupSnapshotsTest-357169460 None] group_snapshot 84d334ed-bdbd-4403-a6c3-f5c99c09efcc: created successfully
Nov 07 02:32:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] group_snapshot 84d334ed-bdbd-4403-a6c3-f5c99c09efcc: deleting
Nov 07 02:32:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] group_snapshot 84d334ed-bdbd-4403-a6c3-f5c99c09efcc: deleting {{(pid=87087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 07 02:32:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-ac17f6e1-4bed-463b-af85-2f8bf8540438" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-ac17f6e1-4bed-463b-af85-2f8bf8540438" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-9a289f5b-ec89-498f-b824-7d9967c6ea76" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-9a289f5b-ec89-498f-b824-7d9967c6ea76" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Deleting offline snapshot 9a289f5b-ec89-498f-b824-7d9967c6ea76 of volume ac17f6e1-4bed-463b-af85-2f8bf8540438 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:32:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] snapshot_file for this snap is: volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:32:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73795d7-483b-4a26-93e1-3d7f1b73facc]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:47 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76
Nov 07 02:32:47 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:48 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76" returned: 0 in 0.665s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac17f6e1-4bed-463b-af85-2f8bf8540438(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:32:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c059144-8dce-4e17-af3a-a1c98e16a0ba]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:48 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438
Nov 07 02:32:48 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:48 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438" returned: 0 in 0.644s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:48 devstack sudo[89144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76
Nov 07 02:32:48 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:49 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76" returned: 0 in 0.670s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:49 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76
Nov 07 02:32:49 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Flow 'volume_create_manager' (9192c9d7-0be5-4de1-a1e3-b11fa65c9157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a57a8f-9d66-4a8a-9e23-345aa1a5ede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a57a8f-9d66-4a8a-9e23-345aa1a5ede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1325956235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe8a004-7af1-430f-b685-28f9bd5e809d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ed3fadb3e348e992d32e52d56e21d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:49Z,use_quota=True,user_id='12e78f1901e44ebe820bae9ef87dbcd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd94ea7-bc04-4a07-9da1-379f4a0ae4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd94ea7-bc04-4a07-9da1-379f4a0ae4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61b59cf-e5d6-49bd-89f6-b4192ab64464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61b59cf-e5d6-49bd-89f6-b4192ab64464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe8a004-7af1-430f-b685-28f9bd5e809d', 'volume_name': 'volume-7fe8a004-7af1-430f-b685-28f9bd5e809d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68fd63b-7913-49c1-8496-e0a1c5bc6947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68fd63b-7913-49c1-8496-e0a1c5bc6947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898d1224-25b0-47e3-bf8d-085dc29ebe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:49 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Volume 7fe8a004-7af1-430f-b685-28f9bd5e809d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe8a004-7af1-430f-b685-28f9bd5e809d', 'volume_size': 1}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1325956235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe8a004-7af1-430f-b685-28f9bd5e809d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ed3fadb3e348e992d32e52d56e21d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:49Z,use_quota=True,user_id='12e78f1901e44ebe820bae9ef87dbcd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Creating volume 7fe8a004-7af1-430f-b685-28f9bd5e809d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:32:49 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:49 devstack sudo[89151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d 1073741824
Nov 07 02:32:49 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:49 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438.9a289f5b-ec89-498f-b824-7d9967c6ea76" returned: 0 in 0.334s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-9a289f5b-ec89-498f-b824-7d9967c6ea76" released by "_delete_snapshot" :: held 2.485s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-ac17f6e1-4bed-463b-af85-2f8bf8540438" released by "delete_snapshot" :: held 2.518s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-4479b41d-29db-4268-bbdf-3ac1c581df6f" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-4479b41d-29db-4268-bbdf-3ac1c581df6f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-b982b1c6-3752-4020-897d-f3d260fabcf2" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-b982b1c6-3752-4020-897d-f3d260fabcf2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Deleting offline snapshot b982b1c6-3752-4020-897d-f3d260fabcf2 of volume 4479b41d-29db-4268-bbdf-3ac1c581df6f {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] snapshot_file for this snap is: volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d69762-f8d7-4590-a5b6-d5e8435e1b2a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:50 devstack sudo[89157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2
Nov 07 02:32:50 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:50 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d 1073741824" returned: 0 in 0.652s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:50 devstack sudo[89162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d
Nov 07 02:32:50 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:50 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2" returned: 0 in 0.600s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4479b41d-29db-4268-bbdf-3ac1c581df6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[52387bce-f5d2-4aa0-b50b-27686c9aeb99]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:50 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:50 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d" returned: 0 in 0.373s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:50 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898d1224-25b0-47e3-bf8d-085dc29ebe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe8a004-7af1-430f-b685-28f9bd5e809d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2acb2fc-dc8d-4971-b875-962b9280ac3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:50 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Volume volume-7fe8a004-7af1-430f-b685-28f9bd5e809d (7fe8a004-7af1-430f-b685-28f9bd5e809d): created successfully
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2acb2fc-dc8d-4971-b875-962b9280ac3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Flow 'volume_create_manager' (9192c9d7-0be5-4de1-a1e3-b11fa65c9157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:32:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-98db8941-5386-4397-b2bd-abaa776a45ca tempest-TaggedAttachmentsTest-8540521 None] Created volume successfully.
Nov 07 02:32:51 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f" returned: 0 in 0.586s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:51 devstack sudo[89184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2
Nov 07 02:32:51 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:51 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2" returned: 0 in 0.601s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:51 devstack sudo[89219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2
Nov 07 02:32:51 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:52 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f.b982b1c6-3752-4020-897d-f3d260fabcf2" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-b982b1c6-3752-4020-897d-f3d260fabcf2" released by "_delete_snapshot" :: held 2.330s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-4479b41d-29db-4268-bbdf-3ac1c581df6f" released by "delete_snapshot" :: held 2.366s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:52 devstack cinder-volume[87087]: WARNING cinder.quota [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1617347527 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1617347527, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:32:52 devstack cinder-volume[87087]: WARNING cinder.quota [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1617347527 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1617347527, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:32:52 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Created reservations ['f5fa0be3-ec9a-4ac1-adf3-7829401ab349', 'bfd66f3c-fd76-43ab-86a6-25dbf61f1d3b', 'bb5cd01c-4cbf-476c-9584-47e416561f20', '70c9431e-6723-4e82-8a9e-3c2147e8906e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:52 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] Created reservations ['e80b40e7-8f15-4eab-bcce-28d2ca868ba6', 'c717dd4a-9132-4a29-bf11-bf64ea8f5841', '10e4d89a-6a65-42f7-aa3f-282edbcc19b4', '3cfbb235-258d-4362-9a63-33348355112c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-603229c0-c067-427f-bdcc-624bd73bbd1a tempest-GroupSnapshotsTest-357169460 None] group_snapshot 84d334ed-bdbd-4403-a6c3-f5c99c09efcc: deleted successfully
Nov 07 02:32:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:32:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:53 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:32:53 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-4479b41d-29db-4268-bbdf-3ac1c581df6f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-4479b41d-29db-4268-bbdf-3ac1c581df6f" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:53 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.673s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:54 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:32:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6a6a81-6041-413a-aa39-8fd30a14b4d9]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:54 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f
Nov 07 02:32:54 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:54 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f" returned: 0 in 0.649s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:54 devstack sudo[89237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f
Nov 07 02:32:54 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:55 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4479b41d-29db-4268-bbdf-3ac1c581df6f" returned: 0 in 0.297s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-4479b41d-29db-4268-bbdf-3ac1c581df6f" released by "delete_volume" :: held 1.067s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-ac17f6e1-4bed-463b-af85-2f8bf8540438" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-ac17f6e1-4bed-463b-af85-2f8bf8540438" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbbf061-d83d-47c7-a82e-4fc251705360]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:55 devstack sudo[89241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438
Nov 07 02:32:55 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:55 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438" returned: 0 in 0.705s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:55 devstack sudo[89246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438
Nov 07 02:32:55 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:56 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac17f6e1-4bed-463b-af85-2f8bf8540438" returned: 0 in 0.482s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-ac17f6e1-4bed-463b-af85-2f8bf8540438" released by "delete_volume" :: held 1.346s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:56 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Created reservations ['1ee0d2f5-0df5-4c3e-bb3c-74411acb3950'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:56 devstack cinder-volume[87087]: WARNING cinder.quota [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1617347527 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1617347527, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:32:56 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Created reservations ['f6a46f86-23cd-43ab-9060-f2342f951502', '2e5b774d-c3bd-4f8a-991c-2cd9f68ed650', '16d77858-135d-4dfa-bb71-5e15bfaa1a20', '214cb4dc-7f94-4789-8277-4c1fa2397204'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Created reservations ['e65f18fb-7436-40fe-aae3-b6cd85c55d87', '794e0c25-8a9c-430d-a747-796be67643e0', '7b969c6c-b179-48ac-8c80-b02e881a8cc4', '2bb68356-280e-41b1-8041-808eb854f5be'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:57 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:32:57 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:57 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.371s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:57 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:32:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-118580c7-64d2-4321-a72d-8adf47060298 tempest-GroupSnapshotsTest-357169460 None] Delete group completed successfully.
Nov 07 02:32:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8c976b9b-f6c4-4222-94c8-086745efd646 tempest-GroupSnapshotsTest-357169460 None] Group tempest-GroupSnapshotsTest-Group-398652384: creating
Nov 07 02:32:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8c976b9b-f6c4-4222-94c8-086745efd646 tempest-GroupSnapshotsTest-357169460 None] Group tempest-GroupSnapshotsTest-Group-398652384: created successfully
Nov 07 02:32:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8c976b9b-f6c4-4222-94c8-086745efd646 tempest-GroupSnapshotsTest-357169460 None] Create group completed successfully.
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Flow 'volume_create_manager' (815c7f9b-b966-4c58-a279-085afe6b8ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3ce534-df75-46e7-a548-1ff30cda6e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3ce534-df75-46e7-a548-1ff30cda6e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1034564191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2b0d203d-b5e7-4d68-8722-a6ea978c287b,host='devstack@QuobyteHD#QuobyteHD',id=2826250b-279f-4c5e-b830-cfc7dd1cacdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113f1377b49449d7b698b69bb14f556f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:01Z,use_quota=True,user_id='c2c0b99416f6498594986a50ab7f6089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(faf07d00-cfed-4380-81c4-499a0d8d0518),volume_type_id=faf07d00-cfed-4380-81c4-499a0d8d0518)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc752fd1-fe74-4f23-86f6-f18e9dd03ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc752fd1-fe74-4f23-86f6-f18e9dd03ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871f3251-d909-43e8-bc5e-7af1782c1176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871f3251-d909-43e8-bc5e-7af1782c1176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2826250b-279f-4c5e-b830-cfc7dd1cacdb', 'volume_name': 'volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a6a56b-8954-4604-8e1b-99bc739adf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a6a56b-8954-4604-8e1b-99bc739adf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a349a1b4-64c8-4727-b435-247743157d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:00 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Volume 2826250b-279f-4c5e-b830-cfc7dd1cacdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb', 'volume_size': 1}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2b0d203d-b5e7-4d68-8722-a6ea978c287b,created_at=2026-11-07T01:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1034564191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2b0d203d-b5e7-4d68-8722-a6ea978c287b,host='devstack@QuobyteHD#QuobyteHD',id=2826250b-279f-4c5e-b830-cfc7dd1cacdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113f1377b49449d7b698b69bb14f556f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:01Z,use_quota=True,user_id='c2c0b99416f6498594986a50ab7f6089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(faf07d00-cfed-4380-81c4-499a0d8d0518),volume_type_id=faf07d00-cfed-4380-81c4-499a0d8d0518)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Creating volume 2826250b-279f-4c5e-b830-cfc7dd1cacdb {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:33:00 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:33:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:01 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb 1073741824
Nov 07 02:33:01 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Flow 'volume_create_manager' (061eb1b3-851c-451a-987e-5a17ae40bf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9629a16f-89ce-4302-a070-3ebbde70bb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9629a16f-89ce-4302-a070-3ebbde70bb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-614393243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f6ede8-e78f-4b1b-8c82-5ee8c48d5106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7001ed26fd64ddea80ce3d1858ed49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:01Z,use_quota=True,user_id='770a6f02523648e490ead52e537cd437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51075a5d-0a83-47f1-8269-7ee5bcd57472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51075a5d-0a83-47f1-8269-7ee5bcd57472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28e8ce9-064e-47ee-80da-87278c6d176f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28e8ce9-064e-47ee-80da-87278c6d176f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f6ede8-e78f-4b1b-8c82-5ee8c48d5106', 'volume_name': 'volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a79c5f5-a455-429d-a69b-d56d15dfa12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a79c5f5-a455-429d-a69b-d56d15dfa12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e102fc11-1fd8-4794-95c5-2bf6c5d9599d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:01 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Volume 22f6ede8-e78f-4b1b-8c82-5ee8c48d5106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106', 'volume_size': 1}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:01 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb 1073741824" returned: 0 in 0.788s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:01 devstack sudo[89300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb
Nov 07 02:33:01 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:02 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb" returned: 0 in 0.320s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-614393243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f6ede8-e78f-4b1b-8c82-5ee8c48d5106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7001ed26fd64ddea80ce3d1858ed49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:01Z,use_quota=True,user_id='770a6f02523648e490ead52e537cd437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Creating volume 22f6ede8-e78f-4b1b-8c82-5ee8c48d5106 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:33:02 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a349a1b4-64c8-4727-b435-247743157d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd07ac4-0bb8-4015-953b-4d152c4f4a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:02 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106 1073741824
Nov 07 02:33:02 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:02 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Volume volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb (2826250b-279f-4c5e-b830-cfc7dd1cacdb): created successfully
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd07ac4-0bb8-4015-953b-4d152c4f4a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Flow 'volume_create_manager' (815c7f9b-b966-4c58-a279-085afe6b8ac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f8368a5f-09bb-491d-9429-cd7af86f3d2f tempest-GroupSnapshotsTest-357169460 None] Created volume successfully.
Nov 07 02:33:02 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106 1073741824" returned: 0 in 0.734s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:02 devstack sudo[89320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106
Nov 07 02:33:02 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:03 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106" returned: 0 in 0.300s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e102fc11-1fd8-4794-95c5-2bf6c5d9599d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1192b53c-e83b-468e-bc22-b7d9e3093343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:03 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Volume volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106 (22f6ede8-e78f-4b1b-8c82-5ee8c48d5106): created successfully
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1192b53c-e83b-468e-bc22-b7d9e3093343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Flow 'volume_create_manager' (061eb1b3-851c-451a-987e-5a17ae40bf5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a447f274-11fb-4d73-a9e5-fbd406d16dbe tempest-ServersNegativeTestJSON-1583630767 None] Created volume successfully.
Nov 07 02:33:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] GroupSnapshot fbddd8b1-81d5-4045-945d-cdc695da169b: creating.
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] Group snapshot fbddd8b1-81d5-4045-945d-cdc695da169b: creating. {{(pid=87087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] Creating offline snapshot ea1b716a-d548-4267-8296-77ea3fe17f64 of volume 2826250b-279f-4c5e-b830-cfc7dd1cacdb {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2128b572-2e3b-482d-8dfc-a40cc576ea8c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:04 devstack sudo[89323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb
Nov 07 02:33:04 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:04 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb" returned: 0 in 0.519s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:04 devstack sudo[89329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64 1G
Nov 07 02:33:04 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:05 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64 1G" returned: 0 in 0.562s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:05 devstack sudo[89336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64
Nov 07 02:33:05 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:05 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64" returned: 0 in 0.610s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:05 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64 is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:05 devstack sudo[89371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64
Nov 07 02:33:05 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Flow 'volume_create_manager' (7df55819-bca6-4b0e-9523-6027c1ce219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77483e86-2297-481e-8baa-6c64c355c46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77483e86-2297-481e-8baa-6c64c355c46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-815638898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6755b39a-6878-4044-a016-01aeb23060dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7001ed26fd64ddea80ce3d1858ed49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:06Z,use_quota=True,user_id='770a6f02523648e490ead52e537cd437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4deddd3b-a566-41dd-b25c-90cfed1c7f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4deddd3b-a566-41dd-b25c-90cfed1c7f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282bd9bc-18aa-462f-b377-b4909d647b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282bd9bc-18aa-462f-b377-b4909d647b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6755b39a-6878-4044-a016-01aeb23060dd', 'volume_name': 'volume-6755b39a-6878-4044-a016-01aeb23060dd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d88ab20-40ed-4989-ae1c-6d2e50c006f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d88ab20-40ed-4989-ae1c-6d2e50c006f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67ba0f8-3226-4d11-aca8-c7c5a401b117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:05 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Volume 6755b39a-6878-4044-a016-01aeb23060dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6755b39a-6878-4044-a016-01aeb23060dd', 'volume_size': 1}
Nov 07 02:33:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:06 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64" returned: 0 in 0.337s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:06 devstack sudo[89384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.info
Nov 07 02:33:06 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:06 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.info" returned: 0 in 0.374s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:06 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:06 devstack sudo[89397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.info
Nov 07 02:33:06 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:06 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.info" returned: 0 in 0.407s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.987s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-815638898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6755b39a-6878-4044-a016-01aeb23060dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7001ed26fd64ddea80ce3d1858ed49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:06Z,use_quota=True,user_id='770a6f02523648e490ead52e537cd437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Creating volume 6755b39a-6878-4044-a016-01aeb23060dd {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:33:06 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:33:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:06 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd 1073741824
Nov 07 02:33:06 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dcff8400-131c-4548-a061-f43150a04916 tempest-GroupSnapshotsTest-357169460 None] group_snapshot fbddd8b1-81d5-4045-945d-cdc695da169b: created successfully
Nov 07 02:33:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] group_snapshot fbddd8b1-81d5-4045-945d-cdc695da169b: deleting
Nov 07 02:33:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] group_snapshot fbddd8b1-81d5-4045-945d-cdc695da169b: deleting {{(pid=87087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 07 02:33:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-2826250b-279f-4c5e-b830-cfc7dd1cacdb" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-2826250b-279f-4c5e-b830-cfc7dd1cacdb" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-ea1b716a-d548-4267-8296-77ea3fe17f64" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-ea1b716a-d548-4267-8296-77ea3fe17f64" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Deleting offline snapshot ea1b716a-d548-4267-8296-77ea3fe17f64 of volume 2826250b-279f-4c5e-b830-cfc7dd1cacdb {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:33:07 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] snapshot_file for this snap is: volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:33:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd 1073741824" returned: 0 in 0.778s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3a3312-6488-4ccd-ad60-93c9afd652da]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:07 devstack sudo[89428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd
Nov 07 02:33:07 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:07 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64
Nov 07 02:33:07 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:08 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd" returned: 0 in 0.484s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67ba0f8-3226-4d11-aca8-c7c5a401b117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6755b39a-6878-4044-a016-01aeb23060dd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24368d0e-d94b-4778-8f35-a7cacf39d558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Volume volume-6755b39a-6878-4044-a016-01aeb23060dd (6755b39a-6878-4044-a016-01aeb23060dd): created successfully
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24368d0e-d94b-4778-8f35-a7cacf39d558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Flow 'volume_create_manager' (7df55819-bca6-4b0e-9523-6027c1ce219c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-bd9e830e-623b-4071-bba7-a1a344254c3d tempest-ServersNegativeTestJSON-1583630767 None] Created volume successfully.
Nov 07 02:33:08 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64" returned: 0 in 0.705s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe82106-faf7-448f-bcc7-728e1e613ccc]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:08 devstack sudo[89437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb
Nov 07 02:33:08 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:08 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb" returned: 0 in 0.472s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:08 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64
Nov 07 02:33:08 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:09 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64" returned: 0 in 0.458s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:09 devstack sudo[89448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64
Nov 07 02:33:09 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:09 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb.ea1b716a-d548-4267-8296-77ea3fe17f64" returned: 0 in 0.300s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-ea1b716a-d548-4267-8296-77ea3fe17f64" released by "_delete_snapshot" :: held 2.147s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-2826250b-279f-4c5e-b830-cfc7dd1cacdb" released by "delete_snapshot" :: held 2.202s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Acquiring lock "cinder-6755b39a-6878-4044-a016-01aeb23060dd-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Lock "cinder-6755b39a-6878-4044-a016-01aeb23060dd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:09 devstack cinder-volume[87087]: WARNING cinder.quota [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1082833295 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1082833295, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:33:09 devstack cinder-volume[87087]: WARNING cinder.quota [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1082833295 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1082833295, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:33:10 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] Created reservations ['bb65b92d-d004-407c-bbfc-bf1fd8cac800', '8da18d60-a6a2-46da-ae10-4e2d1335d25e', '0242b179-5e0d-434e-ad50-dd603d1ae720', '4a35965e-8893-4425-a6d2-243ac2be002c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Acquiring lock "cinder-quobyte-6755b39a-6878-4044-a016-01aeb23060dd" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Lock "cinder-quobyte-6755b39a-6878-4044-a016-01aeb23060dd" acquired by "delete_volume" :: waited 0.043s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fe6288-55b5-4ec4-a08d-85ac46f063fa]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-23c5fa0b-3eea-4d24-b192-9fd2c57669d4 tempest-GroupSnapshotsTest-357169460 None] group_snapshot fbddd8b1-81d5-4045-945d-cdc695da169b: deleted successfully
Nov 07 02:33:10 devstack sudo[89453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd
Nov 07 02:33:10 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:10 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd" returned: 0 in 0.521s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:10 devstack sudo[89460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd
Nov 07 02:33:10 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:11 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6755b39a-6878-4044-a016-01aeb23060dd" returned: 0 in 0.411s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Lock "cinder-quobyte-6755b39a-6878-4044-a016-01aeb23060dd" released by "delete_volume" :: held 1.056s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Created reservations ['e04bc4cd-166e-4f90-b71a-b264d8bd528e', '26d6068b-dbaf-4fd8-9ff7-08baaa361907', '57708ea0-52e1-4358-be57-3824e49c7dc2', '5ac178c0-9339-483c-89fe-b7d40af53a57'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:11 devstack sudo[89465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:33:11 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "cinder-quobyte-2826250b-279f-4c5e-b830-cfc7dd1cacdb" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-2826250b-279f-4c5e-b830-cfc7dd1cacdb" acquired by "delete_volume" :: waited 0.059s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[63729edd-9bd9-4b10-9937-95b5324dc3ba]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:11 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.402s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:33:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Deleted volume successfully.
Nov 07 02:33:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d01cdda1-b878-4a92-a067-4825f8588465 tempest-ServersNegativeTestJSON-1583630767 None] Lock "cinder-6755b39a-6878-4044-a016-01aeb23060dd-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:11 devstack sudo[89468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb
Nov 07 02:33:11 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Acquiring lock "cinder-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Lock "cinder-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Acquiring lock "cinder-quobyte-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Lock "cinder-quobyte-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:12 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb" returned: 0 in 0.666s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:12 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39904d8-286e-470c-be43-6812e0611f92]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:12 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb
Nov 07 02:33:12 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:12 devstack sudo[89475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106
Nov 07 02:33:12 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:13 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2826250b-279f-4c5e-b830-cfc7dd1cacdb" returned: 0 in 0.708s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Lock "cinder-quobyte-2826250b-279f-4c5e-b830-cfc7dd1cacdb" released by "delete_volume" :: held 1.516s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:13 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106" returned: 0 in 0.724s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:13 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106
Nov 07 02:33:13 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Created reservations ['ad85ce4c-6654-48af-a2cf-9f8dfcabacea'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:13 devstack cinder-volume[87087]: WARNING cinder.quota [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1082833295 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1082833295, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Created reservations ['f7563672-78fd-4935-bf65-2e9d56fa783c', 'd011ab97-5ac6-42dc-9b27-dee72b0ae3d1', '45685448-e13a-4649-9940-6ffccf69575e', '1b1bfff7-5389-41ae-9791-693a604de998'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:13 devstack sudo[89500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:33:13 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:13 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106" returned: 0 in 0.739s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Lock "cinder-quobyte-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106" released by "delete_volume" :: held 1.542s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:14 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Created reservations ['2a7049f2-e720-4a2b-8f92-4a521c7cb124', '9d1748e0-9417-4aa2-b625-8415a18c17d5', 'cf16c387-8108-421f-b768-fec9da4994ad', '88fba3a7-d00d-4782-ae3d-37c3df22d4ad'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:14 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.527s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:14 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:33:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-718084f9-db5a-4324-8401-019460c11c1e tempest-GroupSnapshotsTest-357169460 None] Delete group completed successfully.
Nov 07 02:33:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:14 devstack sudo[89508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:33:14 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:14 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.503s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:14 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:33:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Deleted volume successfully.
Nov 07 02:33:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-abc7e72e-2e64-4d8f-9182-54b52e3d3b6a tempest-ServersNegativeTestJSON-1583630767 None] Lock "cinder-22f6ede8-e78f-4b1b-8c82-5ee8c48d5106-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:24 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=112,cinder:UPDATE=133,cinder:INSERT=28,cinder:DELETE=3 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:33:24 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=116,cinder:INSERT=30,cinder:UPDATE=114,cinder:DELETE=5 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:33:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-c1c2f148-f447-4f3b-82ef-2daf8ba3e15a req-6ff27357-c55b-4791-b671-8f1dbec86877 tempest-TaggedAttachmentsTest-8540521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-c1c2f148-f447-4f3b-82ef-2daf8ba3e15a req-6ff27357-c55b-4791-b671-8f1dbec86877 tempest-TaggedAttachmentsTest-8540521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-c1c2f148-f447-4f3b-82ef-2daf8ba3e15a req-6ff27357-c55b-4791-b671-8f1dbec86877 tempest-TaggedAttachmentsTest-8540521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-c1c2f148-f447-4f3b-82ef-2daf8ba3e15a req-6ff27357-c55b-4791-b671-8f1dbec86877 tempest-TaggedAttachmentsTest-8540521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-7fe8a004-7af1-430f-b685-28f9bd5e809d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '787e711c-b38a-4566-9c12-047329512467', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:33:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-c1c2f148-f447-4f3b-82ef-2daf8ba3e15a req-6ff27357-c55b-4791-b671-8f1dbec86877 tempest-TaggedAttachmentsTest-8540521 None] attachment_update completed successfully.
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Flow 'volume_create_manager' (8d26599e-d668-4555-94a6-e55c718aebd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d0f6ac-460a-4021-b940-cfd2055db2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d0f6ac-460a-4021-b940-cfd2055db2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1971901454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbde3fd50b7411fb90b7dfa2f6ad5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:46Z,use_quota=True,user_id='59d77445c6944a868d4f479dae695fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2177368-c853-421f-aba1-c27fdc2966e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2177368-c853-421f-aba1-c27fdc2966e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576e1ab3-b472-4d54-8ef6-b6d52d8b7352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576e1ab3-b472-4d54-8ef6-b6d52d8b7352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc', 'volume_name': 'volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99db3c07-bcd5-486a-bfd9-e1e704904ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99db3c07-bcd5-486a-bfd9-e1e704904ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e444446-54d1-494d-b6ae-9beeddcf81ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:45 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Volume a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc', 'volume_size': 1}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1971901454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbde3fd50b7411fb90b7dfa2f6ad5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:46Z,use_quota=True,user_id='59d77445c6944a868d4f479dae695fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Creating volume a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:33:45 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:33:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:46 devstack sudo[90228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc 1073741824
Nov 07 02:33:46 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:46 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc 1073741824" returned: 0 in 0.613s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:46 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc
Nov 07 02:33:46 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:47 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc" returned: 0 in 0.451s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:33:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e444446-54d1-494d-b6ae-9beeddcf81ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c436ffa-1a71-47ea-abcc-434e110b02c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:47 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Volume volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc (a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc): created successfully
Nov 07 02:33:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c436ffa-1a71-47ea-abcc-434e110b02c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Flow 'volume_create_manager' (8d26599e-d668-4555-94a6-e55c718aebd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4ad5048d-a100-4385-b6a5-fe6d3ec62979 tempest-ServerActionsTestOtherA-661875350 None] Created volume successfully.
Nov 07 02:33:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-68bf4258-2253-4312-914f-3580e30c8780 req-586e856c-a24f-4061-8330-b561df602f29 tempest-TaggedAttachmentsTest-8540521 None] Terminate volume connection completed successfully.
Nov 07 02:33:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-68bf4258-2253-4312-914f-3580e30c8780 req-586e856c-a24f-4061-8330-b561df602f29 tempest-TaggedAttachmentsTest-8540521 None] Deleting attachment 787e711c-b38a-4566-9c12-047329512467. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:33:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:33:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:53 devstack sudo[90371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:33:53 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:54 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.714s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:54 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:33:54 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:33:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 8 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:33:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:33:58 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:33:58 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=9,cinder:UPDATE=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:34:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Acquiring lock "cinder-7fe8a004-7af1-430f-b685-28f9bd5e809d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Lock "cinder-7fe8a004-7af1-430f-b685-28f9bd5e809d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Acquiring lock "cinder-quobyte-7fe8a004-7af1-430f-b685-28f9bd5e809d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Lock "cinder-quobyte-7fe8a004-7af1-430f-b685-28f9bd5e809d" acquired by "delete_volume" :: waited 0.040s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e40e7a-0de9-4140-819d-17628752309e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:07 devstack sudo[90494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d
Nov 07 02:34:07 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:08 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d" returned: 0 in 0.768s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:08 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d
Nov 07 02:34:08 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:09 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7fe8a004-7af1-430f-b685-28f9bd5e809d" returned: 0 in 0.753s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Lock "cinder-quobyte-7fe8a004-7af1-430f-b685-28f9bd5e809d" released by "delete_volume" :: held 1.626s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Created reservations ['11f0ab85-f72c-402c-b271-fb1f12b25656', 'd737eb91-f599-41f4-91fc-c3fb34e8498a', '8817ce5e-cb0a-41b7-92fb-ecc99b1eab6a', '74063348-5c2c-4b40-8910-78298bcd5374'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:09 devstack sudo[90531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:34:09 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:09 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.324s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Deleted volume successfully.
Nov 07 02:34:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0b4a5e7-939b-42e8-bb02-a78752f34c45 tempest-TaggedAttachmentsTest-8540521 None] Lock "cinder-7fe8a004-7af1-430f-b685-28f9bd5e809d-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Flow 'volume_create_manager' (eb135978-9906-401d-b69a-a10f7d198985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8a4178-fc1d-4b55-ae2d-3d8f5df4fb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8a4178-fc1d-4b55-ae2d-3d8f5df4fb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-731187942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df48dae-14c5-4e38-a078-eeb3ec6368ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c5802bed4d4b40b0ee60e4ee44bd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:14Z,use_quota=True,user_id='bf33bab1b14f4b8e8a60866d92736edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac231a65-4479-4aa3-b47d-56d9d90771c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac231a65-4479-4aa3-b47d-56d9d90771c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b18c1c-6f57-4564-9c1f-4f898e5e4e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b18c1c-6f57-4564-9c1f-4f898e5e4e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df48dae-14c5-4e38-a078-eeb3ec6368ae', 'volume_name': 'volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d87fc15-a483-4109-bf0c-1915827eed48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d87fc15-a483-4109-bf0c-1915827eed48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654dd007-1e17-4b90-9e18-8e115b9e55e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:14 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Volume 8df48dae-14c5-4e38-a078-eeb3ec6368ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae', 'volume_size': 1}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-731187942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df48dae-14c5-4e38-a078-eeb3ec6368ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c5802bed4d4b40b0ee60e4ee44bd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:14Z,use_quota=True,user_id='bf33bab1b14f4b8e8a60866d92736edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Creating volume 8df48dae-14c5-4e38-a078-eeb3ec6368ae {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:14 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:14 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae 1073741824
Nov 07 02:34:14 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:14 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae 1073741824" returned: 0 in 0.441s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:14 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae
Nov 07 02:34:14 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:15 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae" returned: 0 in 0.315s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654dd007-1e17-4b90-9e18-8e115b9e55e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483e04d6-531e-43ce-9fa8-1d6f1343f89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:15 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Volume volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae (8df48dae-14c5-4e38-a078-eeb3ec6368ae): created successfully
Nov 07 02:34:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483e04d6-531e-43ce-9fa8-1d6f1343f89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Flow 'volume_create_manager' (eb135978-9906-401d-b69a-a10f7d198985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a27b7879-29a8-41c2-a6c7-55cf24f83608 tempest-SnapshotMetadataTestJSON-1585033162 None] Created volume successfully.
Nov 07 02:34:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] Creating offline snapshot ee818a39-4eed-4eca-a5fa-6d7d89a608fe of volume 8df48dae-14c5-4e38-a078-eeb3ec6368ae {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:34:16 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87cb854-9aed-4114-9e1a-69967081a9f7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:16 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae
Nov 07 02:34:16 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:17 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae" returned: 0 in 0.533s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:17 devstack sudo[90571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe 1G
Nov 07 02:34:17 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:17 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe 1G" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:17 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe
Nov 07 02:34:17 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:18 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe" returned: 0 in 0.345s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:18 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe is being set with open permissions: ugo+rw
Nov 07 02:34:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:18 devstack sudo[90581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe
Nov 07 02:34:18 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:18 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe" returned: 0 in 0.275s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:18 devstack sudo[90584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.info
Nov 07 02:34:18 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:18 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.info" returned: 0 in 0.248s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:18 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.info is being set with open permissions: ugo+rw
Nov 07 02:34:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:18 devstack sudo[90587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.info
Nov 07 02:34:18 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:19 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.info" returned: 0 in 0.240s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e4a1ebee-4145-4164-9f30-625db387779a tempest-SnapshotMetadataTestJSON-1585033162 None] Create snapshot completed successfully
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Flow 'volume_create_manager' (15653bfa-455d-476f-a279-01872505e802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a67feb-07f0-43dd-a57c-db8b623f6d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a67feb-07f0-43dd-a57c-db8b623f6d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-986756118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44266b5d-3c0a-4fd0-845a-cfd722a722c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8802a1785d479e8e8560c21cbb603b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:20Z,use_quota=True,user_id='5ec98b951a2141ae82f429fcb62d615c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f7ec22-fc69-4e43-a64f-60b15a4daea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f7ec22-fc69-4e43-a64f-60b15a4daea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6944c094-ea5c-4bcb-8c10-1b33a0ec0921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6944c094-ea5c-4bcb-8c10-1b33a0ec0921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44266b5d-3c0a-4fd0-845a-cfd722a722c0', 'volume_name': 'volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bf4d23-5d8f-4110-9721-ccb992d8bc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bf4d23-5d8f-4110-9721-ccb992d8bc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f972dba4-703e-4333-b9e3-ea6e6bae0ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Volume 44266b5d-3c0a-4fd0-845a-cfd722a722c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0', 'volume_size': 1}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-986756118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44266b5d-3c0a-4fd0-845a-cfd722a722c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8802a1785d479e8e8560c21cbb603b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:20Z,use_quota=True,user_id='5ec98b951a2141ae82f429fcb62d615c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Creating volume 44266b5d-3c0a-4fd0-845a-cfd722a722c0 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:20 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:20 devstack sudo[90593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0 1073741824
Nov 07 02:34:20 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Acquiring lock "cinder-ee818a39-4eed-4eca-a5fa-6d7d89a608fe-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "cinder-ee818a39-4eed-4eca-a5fa-6d7d89a608fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Acquiring lock "cinder-quobyte-8df48dae-14c5-4e38-a078-eeb3ec6368ae" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "cinder-quobyte-8df48dae-14c5-4e38-a078-eeb3ec6368ae" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Acquiring lock "cinder-quobyte-ee818a39-4eed-4eca-a5fa-6d7d89a608fe" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "cinder-quobyte-ee818a39-4eed-4eca-a5fa-6d7d89a608fe" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Deleting offline snapshot ee818a39-4eed-4eca-a5fa-6d7d89a608fe of volume 8df48dae-14c5-4e38-a078-eeb3ec6368ae {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:34:20 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] snapshot_file for this snap is: volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:34:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0 1073741824" returned: 0 in 0.573s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e63f0b-9e07-4887-b0ff-6eaf07c9065a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:21 devstack sudo[90600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0
Nov 07 02:34:21 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:21 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe
Nov 07 02:34:21 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:21 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0" returned: 0 in 0.270s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f972dba4-703e-4333-b9e3-ea6e6bae0ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7e4d3d-2069-4461-916a-0e77a68a1f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Volume volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0 (44266b5d-3c0a-4fd0-845a-cfd722a722c0): created successfully
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7e4d3d-2069-4461-916a-0e77a68a1f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Flow 'volume_create_manager' (15653bfa-455d-476f-a279-01872505e802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ae22724c-0772-4f56-a4f7-22c94c37ab83 tempest-AttachVolumeShelveTestJSON-276934388 None] Created volume successfully.
Nov 07 02:34:21 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe" returned: 0 in 0.447s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[890b6d14-8901-4f17-9671-b364fcffa5bc]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:21 devstack sudo[90607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae
Nov 07 02:34:21 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:21 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae" returned: 0 in 0.368s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:21 devstack sudo[90612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe
Nov 07 02:34:21 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:22 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe" returned: 0 in 0.388s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:22 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe
Nov 07 02:34:22 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:22 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae.ee818a39-4eed-4eca-a5fa-6d7d89a608fe" returned: 0 in 0.295s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "cinder-quobyte-ee818a39-4eed-4eca-a5fa-6d7d89a608fe" released by "_delete_snapshot" :: held 1.618s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "cinder-quobyte-8df48dae-14c5-4e38-a078-eeb3ec6368ae" released by "delete_snapshot" :: held 1.658s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:22 devstack cinder-volume[87087]: WARNING cinder.quota [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:34:22 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Created reservations ['7166244d-7dff-497f-99af-1a065a3be628', '34f591f0-b29d-4330-a54a-a3aa8a3ffca4', '516571c6-5089-4ad3-b686-726eea371f92', 'e3795a05-b478-4989-8bc1-98ad28d81f93'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Delete snapshot completed successfully.
Nov 07 02:34:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bd0cf0fb-281e-42cf-9661-2a8ec465ce55 tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "cinder-ee818a39-4eed-4eca-a5fa-6d7d89a608fe-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Acquiring lock "cinder-8df48dae-14c5-4e38-a078-eeb3ec6368ae-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "cinder-8df48dae-14c5-4e38-a078-eeb3ec6368ae-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Acquiring lock "cinder-quobyte-8df48dae-14c5-4e38-a078-eeb3ec6368ae" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "cinder-quobyte-8df48dae-14c5-4e38-a078-eeb3ec6368ae" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2450634a-177c-4ae8-a566-f9dbe8e1390b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:23 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae
Nov 07 02:34:23 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:23 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:23 devstack sudo[90632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae
Nov 07 02:34:23 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:24 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8df48dae-14c5-4e38-a078-eeb3ec6368ae" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "cinder-quobyte-8df48dae-14c5-4e38-a078-eeb3ec6368ae" released by "delete_volume" :: held 0.793s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Created reservations ['0737516d-f748-4930-81aa-48f330fa1e3e', '13761f06-1838-4baf-adfd-74df77997d1a', 'f6a7b092-8a09-4439-b581-43b99993f62c', '651d59a3-7804-4cb4-b7b0-4388d2e3e108'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:24 devstack sudo[90640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:34:24 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:24 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.376s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Deleted volume successfully.
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1808cfc6-65b9-4d58-9570-626a5f4b3dac tempest-SnapshotMetadataTestJSON-1585033162 None] Lock "cinder-8df48dae-14c5-4e38-a078-eeb3ec6368ae-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Flow 'volume_create_manager' (a83efa70-8652-4dc1-9438-e280c47338ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ade9c4-a06f-4c2f-b012-49548304c7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ade9c4-a06f-4c2f-b012-49548304c7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-733560166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232f1f81-85a2-4813-914b-56e9ce3b50f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72397a8902d54431bdb88f5870f6cdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:25Z,use_quota=True,user_id='767e7e2748bd49cfbb1f0a5a41b6dc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ceb4c9-1b88-42cb-ac67-5b236ae0729c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ceb4c9-1b88-42cb-ac67-5b236ae0729c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45de7803-faa3-4266-91f3-a5228b99cc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45de7803-faa3-4266-91f3-a5228b99cc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232f1f81-85a2-4813-914b-56e9ce3b50f8', 'volume_name': 'volume-232f1f81-85a2-4813-914b-56e9ce3b50f8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dda1e4-d080-4318-b4c6-95ac6a32099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dda1e4-d080-4318-b4c6-95ac6a32099e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eaf3b9d-4e7a-4d73-95cc-82c78a42c061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Volume 232f1f81-85a2-4813-914b-56e9ce3b50f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232f1f81-85a2-4813-914b-56e9ce3b50f8', 'volume_size': 1}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-733560166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232f1f81-85a2-4813-914b-56e9ce3b50f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72397a8902d54431bdb88f5870f6cdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:25Z,use_quota=True,user_id='767e7e2748bd49cfbb1f0a5a41b6dc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Creating volume 232f1f81-85a2-4813-914b-56e9ce3b50f8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:25 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:25 devstack sudo[90651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8 1073741824
Nov 07 02:34:25 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:25 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8 1073741824" returned: 0 in 0.715s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:25 devstack sudo[90658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8
Nov 07 02:34:25 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:26 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eaf3b9d-4e7a-4d73-95cc-82c78a42c061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232f1f81-85a2-4813-914b-56e9ce3b50f8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533e6366-6c09-4ae2-ba9c-6ea1f86f6ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Volume volume-232f1f81-85a2-4813-914b-56e9ce3b50f8 (232f1f81-85a2-4813-914b-56e9ce3b50f8): created successfully
Nov 07 02:34:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533e6366-6c09-4ae2-ba9c-6ea1f86f6ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Flow 'volume_create_manager' (a83efa70-8652-4dc1-9438-e280c47338ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9601f4c3-496e-4996-9b48-91c33396856a tempest-VolumesTestJSON-18242945 None] Created volume successfully.
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Flow 'volume_create_manager' (83b3b83e-626b-48ca-8c64-4fbee8ccf663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a946df-ee2d-4660-bc24-f5b7d409b33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a946df-ee2d-4660-bc24-f5b7d409b33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2011913240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5333b01-d544-4457-8f54-9a21f3839564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72397a8902d54431bdb88f5870f6cdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:28Z,use_quota=True,user_id='767e7e2748bd49cfbb1f0a5a41b6dc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f292bce2-c9e9-4edd-ba16-f4f8a11fd470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f292bce2-c9e9-4edd-ba16-f4f8a11fd470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc37357-d208-4a90-a9a4-8bae243aeb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc37357-d208-4a90-a9a4-8bae243aeb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5333b01-d544-4457-8f54-9a21f3839564', 'volume_name': 'volume-e5333b01-d544-4457-8f54-9a21f3839564', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad78c63-cf6c-4759-b00c-602f15411809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad78c63-cf6c-4759-b00c-602f15411809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e08172e-20b8-4bae-a422-46a96e55f677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Volume e5333b01-d544-4457-8f54-9a21f3839564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5333b01-d544-4457-8f54-9a21f3839564', 'volume_size': 1}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2011913240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5333b01-d544-4457-8f54-9a21f3839564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72397a8902d54431bdb88f5870f6cdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:28Z,use_quota=True,user_id='767e7e2748bd49cfbb1f0a5a41b6dc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Creating volume e5333b01-d544-4457-8f54-9a21f3839564 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:27 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:34:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:27 devstack sudo[90662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564 1073741824
Nov 07 02:34:27 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:28 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564 1073741824" returned: 0 in 0.722s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:28 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564
Nov 07 02:34:28 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:28 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564" returned: 0 in 0.331s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e08172e-20b8-4bae-a422-46a96e55f677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5333b01-d544-4457-8f54-9a21f3839564', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38449856-90b0-47a4-81d9-e6e3711ccf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Volume volume-e5333b01-d544-4457-8f54-9a21f3839564 (e5333b01-d544-4457-8f54-9a21f3839564): created successfully
Nov 07 02:34:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38449856-90b0-47a4-81d9-e6e3711ccf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Flow 'volume_create_manager' (83b3b83e-626b-48ca-8c64-4fbee8ccf663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-44c22e8a-a256-49cb-bc54-ec01f00664d5 tempest-VolumesTestJSON-18242945 None] Created volume successfully.
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Flow 'volume_create_manager' (ee0185aa-7a36-4f6a-8557-22d2ef0ef97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af33cbeb-c8e8-40de-bdf8-d090d00ddc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af33cbeb-c8e8-40de-bdf8-d090d00ddc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1822662800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652de2ef-a376-44c0-b70f-4aad666352e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049d6ba67eab4e84a8fb19be1421f3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:30Z,use_quota=True,user_id='a6a2a165699849e3b4a752ad58d298f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba52c89-6fb6-4d54-9310-afee1556e582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba52c89-6fb6-4d54-9310-afee1556e582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e61e6ba-4734-4fe0-94b6-a15d01fbe983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e61e6ba-4734-4fe0-94b6-a15d01fbe983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652de2ef-a376-44c0-b70f-4aad666352e6', 'volume_name': 'volume-652de2ef-a376-44c0-b70f-4aad666352e6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a47d5b-e1fa-4d13-8fcb-275620cc9488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a47d5b-e1fa-4d13-8fcb-275620cc9488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7b16e8-12cd-4ea4-abd6-e0f5a309bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Volume 652de2ef-a376-44c0-b70f-4aad666352e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652de2ef-a376-44c0-b70f-4aad666352e6', 'volume_size': 1}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1822662800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652de2ef-a376-44c0-b70f-4aad666352e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049d6ba67eab4e84a8fb19be1421f3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:30Z,use_quota=True,user_id='a6a2a165699849e3b4a752ad58d298f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Creating volume 652de2ef-a376-44c0-b70f-4aad666352e6 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:30 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:30 devstack sudo[90724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6 1073741824
Nov 07 02:34:30 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Flow 'volume_create_manager' (25af38dd-d62b-4309-95e5-66d10dc6f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd7a170-81bd-4342-909a-10785c51c3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd7a170-81bd-4342-909a-10785c51c3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-435112278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1268e57d-ea12-4f2a-a82a-608c94cd0293,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72397a8902d54431bdb88f5870f6cdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:31Z,use_quota=True,user_id='767e7e2748bd49cfbb1f0a5a41b6dc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c3eb54-f55a-439a-b799-7b0ae88b8746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c3eb54-f55a-439a-b799-7b0ae88b8746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c3fb30-64b6-4ab1-af57-e1a9ae7e0f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c3fb30-64b6-4ab1-af57-e1a9ae7e0f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1268e57d-ea12-4f2a-a82a-608c94cd0293', 'volume_name': 'volume-1268e57d-ea12-4f2a-a82a-608c94cd0293', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194fc83a-c022-4001-b541-babb0009d443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194fc83a-c022-4001-b541-babb0009d443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9020dd0-6145-486d-993b-6684a760fefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Volume 1268e57d-ea12-4f2a-a82a-608c94cd0293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1268e57d-ea12-4f2a-a82a-608c94cd0293', 'volume_size': 1}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-dd7cad56-4201-4c25-9e29-a30ebcf5e758 req-27c107fc-23cb-4743-81e5-b9ac690f3d02 tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:31 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6 1073741824" returned: 0 in 0.736s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:31 devstack sudo[90753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6
Nov 07 02:34:31 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:31 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6" returned: 0 in 0.257s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.758s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-435112278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1268e57d-ea12-4f2a-a82a-608c94cd0293,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72397a8902d54431bdb88f5870f6cdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:31Z,use_quota=True,user_id='767e7e2748bd49cfbb1f0a5a41b6dc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Creating volume 1268e57d-ea12-4f2a-a82a-608c94cd0293 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:31 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7b16e8-12cd-4ea4-abd6-e0f5a309bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652de2ef-a376-44c0-b70f-4aad666352e6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:31 devstack sudo[90756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293 1073741824
Nov 07 02:34:31 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5982c515-17d2-42ce-b1fd-12b6e411973e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:31 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Volume volume-652de2ef-a376-44c0-b70f-4aad666352e6 (652de2ef-a376-44c0-b70f-4aad666352e6): created successfully
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5982c515-17d2-42ce-b1fd-12b6e411973e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Flow 'volume_create_manager' (ee0185aa-7a36-4f6a-8557-22d2ef0ef97d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5f80d474-2275-4d74-99cb-458c6c208635 tempest-AbsoluteLimitsTests-1186953016 None] Created volume successfully.
Nov 07 02:34:31 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293 1073741824" returned: 0 in 0.409s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:32 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293
Nov 07 02:34:32 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:32 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293" returned: 0 in 0.259s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-dd7cad56-4201-4c25-9e29-a30ebcf5e758 req-27c107fc-23cb-4743-81e5-b9ac690f3d02 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.341s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9020dd0-6145-486d-993b-6684a760fefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1268e57d-ea12-4f2a-a82a-608c94cd0293', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8004e36d-abc4-4728-b912-228c62130920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-dd7cad56-4201-4c25-9e29-a30ebcf5e758 req-27c107fc-23cb-4743-81e5-b9ac690f3d02 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.095s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Volume volume-1268e57d-ea12-4f2a-a82a-608c94cd0293 (1268e57d-ea12-4f2a-a82a-608c94cd0293): created successfully
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8004e36d-abc4-4728-b912-228c62130920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Flow 'volume_create_manager' (25af38dd-d62b-4309-95e5-66d10dc6f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-dd7cad56-4201-4c25-9e29-a30ebcf5e758 req-27c107fc-23cb-4743-81e5-b9ac690f3d02 tempest-ServerActionsTestOtherA-661875350 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f757929-301b-4ba4-9e86-ecf0c4e1d778', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:34:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2ca63b55-cd6e-4473-a6ea-c6420c6c4e9d tempest-VolumesTestJSON-18242945 None] Created volume successfully.
Nov 07 02:34:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-dd7cad56-4201-4c25-9e29-a30ebcf5e758 req-27c107fc-23cb-4743-81e5-b9ac690f3d02 tempest-ServerActionsTestOtherA-661875350 None] attachment_update completed successfully.
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Acquiring lock "cinder-652de2ef-a376-44c0-b70f-4aad666352e6-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Lock "cinder-652de2ef-a376-44c0-b70f-4aad666352e6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Acquiring lock "cinder-quobyte-652de2ef-a376-44c0-b70f-4aad666352e6" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Lock "cinder-quobyte-652de2ef-a376-44c0-b70f-4aad666352e6" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:33 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a283acc1-7364-44ca-8df1-7667b28ac8ab]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:33 devstack sudo[91188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6
Nov 07 02:34:33 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:33 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6" returned: 0 in 0.556s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-70245e6b-afa9-4de8-ab0b-7a5545bc0678 req-37b8e248-e991-46e8-961c-81b1a19071f6 tempest-AttachVolumeShelveTestJSON-276934388 None] No connector for attachment b793a804-c130-4475-b350-3b63d853b8a5; skipping storage backend terminate_connection call. {{(pid=87087) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 07 02:34:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-70245e6b-afa9-4de8-ab0b-7a5545bc0678 req-37b8e248-e991-46e8-961c-81b1a19071f6 tempest-AttachVolumeShelveTestJSON-276934388 None] Deleting attachment b793a804-c130-4475-b350-3b63d853b8a5. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:34:33 devstack sudo[91200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6
Nov 07 02:34:33 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:34 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-652de2ef-a376-44c0-b70f-4aad666352e6" returned: 0 in 0.456s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Lock "cinder-quobyte-652de2ef-a376-44c0-b70f-4aad666352e6" released by "delete_volume" :: held 1.084s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Created reservations ['1d4094d3-2936-4e15-be59-06ab3e45b284', 'd34d1654-181a-4c0b-a789-783ffb2b2fb9', '14fba6af-0c96-4ff1-904a-5b60b89c9ef6', '52f90b83-f1c0-466e-b3ba-2272e9d5fcb3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:34 devstack sudo[91203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:34:34 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:34 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.312s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Deleted volume successfully.
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8285881-2601-4d97-8ffa-5ff030eb1b43 tempest-AbsoluteLimitsTests-1186953016 None] Lock "cinder-652de2ef-a376-44c0-b70f-4aad666352e6-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Acquiring lock "cinder-1268e57d-ea12-4f2a-a82a-608c94cd0293-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Lock "cinder-1268e57d-ea12-4f2a-a82a-608c94cd0293-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Acquiring lock "cinder-quobyte-1268e57d-ea12-4f2a-a82a-608c94cd0293" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Lock "cinder-quobyte-1268e57d-ea12-4f2a-a82a-608c94cd0293" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9407c08d-2595-4671-b7ff-0b37714b61d9]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:35 devstack sudo[91209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293
Nov 07 02:34:35 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:35 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293" returned: 0 in 0.531s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:35 devstack sudo[91217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293
Nov 07 02:34:35 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:35 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1268e57d-ea12-4f2a-a82a-608c94cd0293" returned: 0 in 0.388s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Lock "cinder-quobyte-1268e57d-ea12-4f2a-a82a-608c94cd0293" released by "delete_volume" :: held 1.001s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Created reservations ['d7b4518c-5443-48b8-8773-e7cf62b830ec', 'a7dd4418-f450-4898-ab2e-7c120097ad14', '0df1530f-6967-4409-be24-c169d3a45e63', '41b58c26-c94f-41d4-94ab-16f46c3d433a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:36 devstack sudo[91226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:34:36 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-5742cc78-0478-4504-8b1d-ac9a8840477c req-69b314c2-b6ff-4a0c-b639-7bbfc35cae70 tempest-ServerActionsTestOtherA-661875350 None] Terminate volume connection completed successfully.
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-5742cc78-0478-4504-8b1d-ac9a8840477c req-69b314c2-b6ff-4a0c-b639-7bbfc35cae70 tempest-ServerActionsTestOtherA-661875350 None] Deleting attachment 9f757929-301b-4ba4-9e86-ecf0c4e1d778. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:34:36 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.354s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Deleted volume successfully.
Nov 07 02:34:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-33c54d6d-4d93-4457-8a86-13ae800a3c3d tempest-VolumesTestJSON-18242945 None] Lock "cinder-1268e57d-ea12-4f2a-a82a-608c94cd0293-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Acquiring lock "cinder-e5333b01-d544-4457-8f54-9a21f3839564-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Lock "cinder-e5333b01-d544-4457-8f54-9a21f3839564-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Acquiring lock "cinder-quobyte-e5333b01-d544-4457-8f54-9a21f3839564" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Lock "cinder-quobyte-e5333b01-d544-4457-8f54-9a21f3839564" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9ec160-2d0e-47c6-ac1a-a88cef08071c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-5742cc78-0478-4504-8b1d-ac9a8840477c req-19158724-8ebe-4b7a-944f-8577d038549d tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-5742cc78-0478-4504-8b1d-ac9a8840477c req-19158724-8ebe-4b7a-944f-8577d038549d tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-5742cc78-0478-4504-8b1d-ac9a8840477c req-19158724-8ebe-4b7a-944f-8577d038549d tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:37 devstack sudo[91282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564
Nov 07 02:34:37 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-5742cc78-0478-4504-8b1d-ac9a8840477c req-19158724-8ebe-4b7a-944f-8577d038549d tempest-ServerActionsTestOtherA-661875350 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7dfee1c-1dce-4b7d-80f5-72a522afa419', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:34:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-5742cc78-0478-4504-8b1d-ac9a8840477c req-19158724-8ebe-4b7a-944f-8577d038549d tempest-ServerActionsTestOtherA-661875350 None] attachment_update completed successfully.
Nov 07 02:34:37 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564" returned: 0 in 0.467s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:38 devstack sudo[91287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564
Nov 07 02:34:38 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:38 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e5333b01-d544-4457-8f54-9a21f3839564" returned: 0 in 0.487s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Lock "cinder-quobyte-e5333b01-d544-4457-8f54-9a21f3839564" released by "delete_volume" :: held 1.050s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Created reservations ['a942b1bf-9f64-4720-b709-5051da690dea', 'd88255a1-dbbd-48a2-a267-a46b8da4ee52', 'c592b04a-2e1d-42d0-9076-cf857ec1a507', 'ddc6a7e6-e92b-485b-9caf-8721a6caaaf0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:38 devstack sudo[91304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:34:38 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Acquiring lock "cinder-232f1f81-85a2-4813-914b-56e9ce3b50f8-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:39 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.419s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:39 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Lock "cinder-232f1f81-85a2-4813-914b-56e9ce3b50f8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Deleted volume successfully.
Nov 07 02:34:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a9ef0fb2-5f51-43de-9c94-9373e508bb04 tempest-VolumesTestJSON-18242945 None] Lock "cinder-e5333b01-d544-4457-8f54-9a21f3839564-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Acquiring lock "cinder-quobyte-232f1f81-85a2-4813-914b-56e9ce3b50f8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Lock "cinder-quobyte-232f1f81-85a2-4813-914b-56e9ce3b50f8" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3520288a-64f3-4dda-ab28-42c6aff00f38]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:39 devstack sudo[91314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8
Nov 07 02:34:39 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:39 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8" returned: 0 in 0.648s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:40 devstack sudo[91434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8
Nov 07 02:34:40 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:40 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-232f1f81-85a2-4813-914b-56e9ce3b50f8" returned: 0 in 0.556s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Lock "cinder-quobyte-232f1f81-85a2-4813-914b-56e9ce3b50f8" released by "delete_volume" :: held 1.266s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:40 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Created reservations ['db88752d-587a-46f6-8b2a-a004549f996a', '42a2a24c-0165-4f22-aa5b-9235fb875727', '2e8c4e34-89ee-4b7b-9abb-9f8c4a7cc6c1', 'c669c42d-7cc0-4df8-a84b-fb35b0e1fd25'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:40 devstack sudo[91774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:34:40 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:41 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.379s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:41 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Deleted volume successfully.
Nov 07 02:34:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a4203c55-ec84-48ce-8b50-18f70be6da84 tempest-VolumesTestJSON-18242945 None] Lock "cinder-232f1f81-85a2-4813-914b-56e9ce3b50f8-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Flow 'volume_create_manager' (956b7459-2888-4967-8098-3bd0133b8da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b144611a-dc75-4b68-991e-50395b256b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b144611a-dc75-4b68-991e-50395b256b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1029853021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94fb25d-2b52-4ae4-8553-7fe6fc669360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951a5274abe14fef93f1f8981304a5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:45Z,use_quota=True,user_id='3db436f854624e5c8ebd869c4b38e963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17f0c62-8395-428a-b4bf-394c7cf499e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17f0c62-8395-428a-b4bf-394c7cf499e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cf5da2-b3d4-4f48-aea3-9d8280f5f23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cf5da2-b3d4-4f48-aea3-9d8280f5f23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94fb25d-2b52-4ae4-8553-7fe6fc669360', 'volume_name': 'volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6f74cb-e654-49da-b4e6-df526dda7e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6f74cb-e654-49da-b4e6-df526dda7e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9cf191-f951-455b-8c6c-ad7a8897a0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:45 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Volume d94fb25d-2b52-4ae4-8553-7fe6fc669360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360', 'volume_size': 1}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1029853021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94fb25d-2b52-4ae4-8553-7fe6fc669360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951a5274abe14fef93f1f8981304a5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:45Z,use_quota=True,user_id='3db436f854624e5c8ebd869c4b38e963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Creating volume d94fb25d-2b52-4ae4-8553-7fe6fc669360 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:45 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:34:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:45 devstack sudo[91828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 1073741824
Nov 07 02:34:45 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:46 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 1073741824" returned: 0 in 0.616s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:46 devstack sudo[91841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360
Nov 07 02:34:46 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:46 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360" returned: 0 in 0.439s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9cf191-f951-455b-8c6c-ad7a8897a0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6011ccad-b7a9-489a-ba6a-65fa1864a0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:46 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Volume volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 (d94fb25d-2b52-4ae4-8553-7fe6fc669360): created successfully
Nov 07 02:34:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6011ccad-b7a9-489a-ba6a-65fa1864a0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Flow 'volume_create_manager' (956b7459-2888-4967-8098-3bd0133b8da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-88ac284e-7a9c-4401-9b88-b9bd62c97c7a tempest-VolumesDeleteCascade-167942625 None] Created volume successfully.
Nov 07 02:34:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] Creating offline snapshot c328a785-f472-4c0b-930a-5fb081ed51f1 of volume d94fb25d-2b52-4ae4-8553-7fe6fc669360 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:34:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc65953-cdc5-4810-a3ea-124f45c39de9]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:48 devstack sudo[91857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360
Nov 07 02:34:48 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:48 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360" returned: 0 in 0.872s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:48 devstack sudo[91906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 1G
Nov 07 02:34:48 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b06d8980-e16d-4ed3-82a4-c2c61302866a tempest-GroupsTest-589894907 None] Group tempest-Group1-1223293617: creating
Nov 07 02:34:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b06d8980-e16d-4ed3-82a4-c2c61302866a tempest-GroupsTest-589894907 None] Group tempest-Group1-1223293617: created successfully
Nov 07 02:34:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b06d8980-e16d-4ed3-82a4-c2c61302866a tempest-GroupsTest-589894907 None] Create group completed successfully.
Nov 07 02:34:49 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 1G" returned: 0 in 0.868s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:49 devstack sudo[91923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1
Nov 07 02:34:49 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:50 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1" returned: 0 in 0.465s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:50 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 is being set with open permissions: ugo+rw
Nov 07 02:34:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:50 devstack sudo[91932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1
Nov 07 02:34:50 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:50 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1" returned: 0 in 0.429s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:50 devstack sudo[91936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.info
Nov 07 02:34:50 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-134c65a3-7147-4743-ad63-2358a8ef52a8 tempest-GroupsTest-589894907 None] Group tempest-Group2-2048188544: creating
Nov 07 02:34:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-134c65a3-7147-4743-ad63-2358a8ef52a8 tempest-GroupsTest-589894907 None] Group tempest-Group2-2048188544: created successfully
Nov 07 02:34:51 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.info" returned: 0 in 0.388s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:51 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.info is being set with open permissions: ugo+rw
Nov 07 02:34:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-134c65a3-7147-4743-ad63-2358a8ef52a8 tempest-GroupsTest-589894907 None] Create group completed successfully.
Nov 07 02:34:51 devstack sudo[91939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.info
Nov 07 02:34:51 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:51 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.info" returned: 0 in 0.372s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.622s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-66ac3bea-1153-4bb6-8638-1560539675d2 tempest-VolumesDeleteCascade-167942625 None] Create snapshot completed successfully
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] Creating offline snapshot 82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 of volume d94fb25d-2b52-4ae4-8553-7fe6fc669360 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b490597a-109e-464e-a5c9-2dddefa1238a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:52 devstack sudo[91943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1
Nov 07 02:34:52 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Flow 'volume_create_manager' (faad8780-15a6-47ca-9afc-648ddc0cd57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53065df6-07b6-4ac4-a81e-b9c55cd46589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53065df6-07b6-4ac4-a81e-b9c55cd46589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-282773548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bbacca6c-d6ff-4af9-bad8-6f2c6c50041d,host='devstack@QuobyteHD#QuobyteHD',id=7d039479-5a6b-441a-95b9-124b0ef212d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229869a24ea044dca7d76e64164d4eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:53Z,use_quota=True,user_id='c8958806d4b44f55b2d32886088e28f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0479c10a-15cd-4bbd-bd75-53c2cf70ff30),volume_type_id=0479c10a-15cd-4bbd-bd75-53c2cf70ff30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43567777-9f9c-482a-9e0c-44f4beaae4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43567777-9f9c-482a-9e0c-44f4beaae4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3efaed-d5c7-4dba-a0ff-bd00b8df3521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3efaed-d5c7-4dba-a0ff-bd00b8df3521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d039479-5a6b-441a-95b9-124b0ef212d6', 'volume_name': 'volume-7d039479-5a6b-441a-95b9-124b0ef212d6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4d072b-a087-4a0b-b292-76145a1eb931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4d072b-a087-4a0b-b292-76145a1eb931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15aba89-1d9b-4025-ad37-4f53570c4ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:52 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Volume 7d039479-5a6b-441a-95b9-124b0ef212d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d039479-5a6b-441a-95b9-124b0ef212d6', 'volume_size': 1}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:52 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1" returned: 0 in 0.620s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:34:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:53 devstack sudo[91948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 1G
Nov 07 02:34:53 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:53 devstack sudo[91954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:34:53 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:53 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 1G" returned: 0 in 0.488s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:53 devstack sudo[91956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1
Nov 07 02:34:53 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:53 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.373s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:53 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1" returned: 0 in 0.332s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:53 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 is being set with open permissions: ugo+rw
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 8 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:34:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:34:53 devstack sudo[91963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1
Nov 07 02:34:53 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:54 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1" returned: 0 in 0.285s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.291s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bbacca6c-d6ff-4af9-bad8-6f2c6c50041d,created_at=2026-11-07T01:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-282773548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bbacca6c-d6ff-4af9-bad8-6f2c6c50041d,host='devstack@QuobyteHD#QuobyteHD',id=7d039479-5a6b-441a-95b9-124b0ef212d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229869a24ea044dca7d76e64164d4eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:53Z,use_quota=True,user_id='c8958806d4b44f55b2d32886088e28f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0479c10a-15cd-4bbd-bd75-53c2cf70ff30),volume_type_id=0479c10a-15cd-4bbd-bd75-53c2cf70ff30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Creating volume 7d039479-5a6b-441a-95b9-124b0ef212d6 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:54 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:54 devstack sudo[91966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6 1073741824
Nov 07 02:34:54 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b88f960f-a088-4502-bb58-c5a96a6215c0 tempest-VolumesDeleteCascade-167942625 None] Create snapshot completed successfully
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-d94fb25d-2b52-4ae4-8553-7fe6fc669360-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-d94fb25d-2b52-4ae4-8553-7fe6fc669360-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Performing cascade delete. {{(pid=87087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-82c2bfbf-a72e-4083-ab64-254a4f5fd1f1-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-82c2bfbf-a72e-4083-ab64-254a4f5fd1f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-quobyte-d94fb25d-2b52-4ae4-8553-7fe6fc669360" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-d94fb25d-2b52-4ae4-8553-7fe6fc669360" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-quobyte-82c2bfbf-a72e-4083-ab64-254a4f5fd1f1" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-82c2bfbf-a72e-4083-ab64-254a4f5fd1f1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Deleting offline snapshot 82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 of volume d94fb25d-2b52-4ae4-8553-7fe6fc669360 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] snapshot_file for this snap is: volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab18776-02ae-47aa-a740-0d204dcd6770]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:54 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6 1073741824" returned: 0 in 0.654s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:54 devstack sudo[91996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1
Nov 07 02:34:54 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:54 devstack sudo[92005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6
Nov 07 02:34:54 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:55 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1" returned: 0 in 0.455s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1f9334-ad85-4c6d-ba10-3fc05d174bda]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:55 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15aba89-1d9b-4025-ad37-4f53570c4ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d039479-5a6b-441a-95b9-124b0ef212d6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e4fe78-657a-44d0-8034-09256df720c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Volume volume-7d039479-5a6b-441a-95b9-124b0ef212d6 (7d039479-5a6b-441a-95b9-124b0ef212d6): created successfully
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e4fe78-657a-44d0-8034-09256df720c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Flow 'volume_create_manager' (faad8780-15a6-47ca-9afc-648ddc0cd57b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-74daf3b4-9707-4ec6-ad31-bfd6ea1fa97e tempest-GroupsTest-589894907 None] Created volume successfully.
Nov 07 02:34:55 devstack sudo[92011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1
Nov 07 02:34:55 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:55 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1" returned: 0 in 0.389s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:55 devstack sudo[92016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1
Nov 07 02:34:55 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:55 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:56 devstack sudo[92021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1
Nov 07 02:34:56 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:56 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.82c2bfbf-a72e-4083-ab64-254a4f5fd1f1" returned: 0 in 0.257s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-82c2bfbf-a72e-4083-ab64-254a4f5fd1f1" released by "_delete_snapshot" :: held 1.601s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-d94fb25d-2b52-4ae4-8553-7fe6fc669360" released by "delete_snapshot" :: held 1.631s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Created reservations ['a2b7c28e-cfce-48ea-bad3-50ef186a8f74', 'eb861190-5b71-4b5a-870b-c863505b600b', 'aeb83a03-6bce-4e20-b8ac-306bfe63861a', '10e52e4d-129d-47f5-8cb9-0d01994b21c3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:56 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Delete snapshot completed successfully.
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-82c2bfbf-a72e-4083-ab64-254a4f5fd1f1-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-c328a785-f472-4c0b-930a-5fb081ed51f1-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-c328a785-f472-4c0b-930a-5fb081ed51f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-quobyte-d94fb25d-2b52-4ae4-8553-7fe6fc669360" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-d94fb25d-2b52-4ae4-8553-7fe6fc669360" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-quobyte-c328a785-f472-4c0b-930a-5fb081ed51f1" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-c328a785-f472-4c0b-930a-5fb081ed51f1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Deleting offline snapshot c328a785-f472-4c0b-930a-5fb081ed51f1 of volume d94fb25d-2b52-4ae4-8553-7fe6fc669360 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] snapshot_file for this snap is: volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d95d5e-9110-4e0e-ba44-25d0488dabf7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:56 devstack sudo[92024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1
Nov 07 02:34:56 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:56 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1" returned: 0 in 0.409s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db9c657-70fc-47c0-ad93-aa90fa314a32]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Acquiring lock "cinder-quobyte-7d039479-5a6b-441a-95b9-124b0ef212d6" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Lock "cinder-quobyte-7d039479-5a6b-441a-95b9-124b0ef212d6" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c982517-a7ed-4645-9c39-992b0a3f8463]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:57 devstack sudo[92029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360
Nov 07 02:34:57 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:57 devstack sudo[92030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6
Nov 07 02:34:57 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:57 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360" returned: 0 in 0.425s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:57 devstack sudo[92040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1
Nov 07 02:34:57 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:57 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6" returned: 0 in 0.383s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:57 devstack sudo[92043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6
Nov 07 02:34:57 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:57 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:57 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1" returned: 0 in 0.369s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7d039479-5a6b-441a-95b9-124b0ef212d6" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Lock "cinder-quobyte-7d039479-5a6b-441a-95b9-124b0ef212d6" released by "delete_volume" :: held 0.743s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:57 devstack sudo[92049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1
Nov 07 02:34:57 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Created reservations ['f38ca2e1-cbfd-4839-88a4-2fa41cf53473'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:57 devstack cinder-volume[87087]: WARNING cinder.quota [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1736957529 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1736957529, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:34:57 devstack cinder-volume[87087]: WARNING cinder.quota [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1736957529 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1736957529, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:34:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Created reservations ['a4d68493-008c-4d72-901b-55307794618e', 'a275ca11-fc4f-4454-b194-6035171962ca', 'dbfd9c11-fc4b-4758-8157-42ad3734427a', '642b7cc5-30c2-4e46-9b2d-e6d049452f5a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:58 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360.c328a785-f472-4c0b-930a-5fb081ed51f1" returned: 0 in 0.295s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:58 devstack sudo[92052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:34:58 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-c328a785-f472-4c0b-930a-5fb081ed51f1" released by "_delete_snapshot" :: held 1.609s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-d94fb25d-2b52-4ae4-8553-7fe6fc669360" released by "delete_snapshot" :: held 1.639s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Created reservations ['2b7e303b-c9e1-445a-892c-be3139ee7e1e', '4863841b-c710-45e4-b849-45a027319155', 'e3a4b5db-c78c-48e6-90a2-57731375fadc', '715bb00f-cd4d-43a4-aed8-379e111beca0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Delete snapshot completed successfully.
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-c328a785-f472-4c0b-930a-5fb081ed51f1-delete_snapshot" released by "delete_snapshot" :: held 1.860s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Snapshots deleted, issuing volume delete {{(pid=87087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-quobyte-d94fb25d-2b52-4ae4-8553-7fe6fc669360" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-d94fb25d-2b52-4ae4-8553-7fe6fc669360" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:58 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbd10e1-5f0c-4995-90e9-4f0f784fb527]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.333s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-17e25bd6-6622-4787-8af8-479a44b4a44b tempest-GroupsTest-589894907 None] Delete group completed successfully.
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=105,cinder:UPDATE=104,cinder:INSERT=27,cinder:DELETE=8 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=96,cinder:INSERT=24,cinder:UPDATE=114,cinder:DELETE=9 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5bd6c672-091f-4c64-a6f6-efc55be33604 tempest-GroupsTest-589894907 None] Created reservations ['9e0e2cb6-07de-4fb9-98ec-2e44f75d490b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:58 devstack sudo[92055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5bd6c672-091f-4c64-a6f6-efc55be33604 tempest-GroupsTest-589894907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5bd6c672-091f-4c64-a6f6-efc55be33604 tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:58 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5bd6c672-091f-4c64-a6f6-efc55be33604 tempest-GroupsTest-589894907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5bd6c672-091f-4c64-a6f6-efc55be33604 tempest-GroupsTest-589894907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5bd6c672-091f-4c64-a6f6-efc55be33604 tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5bd6c672-091f-4c64-a6f6-efc55be33604 tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:58 devstack sudo[92057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:34:58 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:58 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360" returned: 0 in 0.444s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:58 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5bd6c672-091f-4c64-a6f6-efc55be33604 tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:58 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-5bd6c672-091f-4c64-a6f6-efc55be33604 tempest-GroupsTest-589894907 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:58 devstack sudo[92064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360
Nov 07 02:34:58 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5bd6c672-091f-4c64-a6f6-efc55be33604 tempest-GroupsTest-589894907 None] Delete group completed successfully.
Nov 07 02:34:59 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d94fb25d-2b52-4ae4-8553-7fe6fc669360" returned: 0 in 0.252s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-d94fb25d-2b52-4ae4-8553-7fe6fc669360" released by "delete_volume" :: held 0.783s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Created reservations ['30903d9e-874a-4db9-abf3-df83e42751e0', 'fd1f09c4-8c53-4d62-b660-f86b2dff4734', '332cf019-6592-4fc5-8da9-6e5200242725', '5fa8e43a-e0de-423d-adc2-0595847dcefd'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:59 devstack sudo[92067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:34:59 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:59 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.247s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Deleted volume successfully.
Nov 07 02:34:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e915e57e-1681-4077-9bae-4617afdb0e85 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-d94fb25d-2b52-4ae4-8553-7fe6fc669360-delete_volume" released by "delete_volume" :: held 5.057s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-627ff359-1870-4e7c-991c-127debe19b59 tempest-GroupsTest-589894907 None] Group tempest-GroupsTest-Group-1905644103: creating
Nov 07 02:35:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-627ff359-1870-4e7c-991c-127debe19b59 tempest-GroupsTest-589894907 None] Group tempest-GroupsTest-Group-1905644103: created successfully
Nov 07 02:35:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-627ff359-1870-4e7c-991c-127debe19b59 tempest-GroupsTest-589894907 None] Create group completed successfully.
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Flow 'volume_create_manager' (35359053-b1c2-4d44-9de1-86da2d0d1dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdf8041-1725-4401-8df7-fb97a0748698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdf8041-1725-4401-8df7-fb97a0748698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-52511445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e0bd37-60af-4206-943e-0a6726ada309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951a5274abe14fef93f1f8981304a5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:01Z,use_quota=True,user_id='3db436f854624e5c8ebd869c4b38e963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c6ba18-4d82-4387-9cf7-7ad8de2caff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c6ba18-4d82-4387-9cf7-7ad8de2caff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc7407f-7cc9-4057-9625-976622a30abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc7407f-7cc9-4057-9625-976622a30abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e0bd37-60af-4206-943e-0a6726ada309', 'volume_name': 'volume-f7e0bd37-60af-4206-943e-0a6726ada309', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b905f2db-686a-4a26-bfff-89fe012bb4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b905f2db-686a-4a26-bfff-89fe012bb4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb63d6ca-0018-4e74-9f98-db81cd4ec73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:00 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Volume f7e0bd37-60af-4206-943e-0a6726ada309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e0bd37-60af-4206-943e-0a6726ada309', 'volume_size': 1}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-52511445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e0bd37-60af-4206-943e-0a6726ada309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951a5274abe14fef93f1f8981304a5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:01Z,use_quota=True,user_id='3db436f854624e5c8ebd869c4b38e963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Creating volume f7e0bd37-60af-4206-943e-0a6726ada309 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:35:00 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:35:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:00 devstack sudo[92094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 1073741824
Nov 07 02:35:00 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:01 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 1073741824" returned: 0 in 0.581s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:01 devstack sudo[92100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309
Nov 07 02:35:01 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:01 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309" returned: 0 in 0.419s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb63d6ca-0018-4e74-9f98-db81cd4ec73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e0bd37-60af-4206-943e-0a6726ada309', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac793799-5c43-4fd5-a21c-0c53d2647b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:02 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Volume volume-f7e0bd37-60af-4206-943e-0a6726ada309 (f7e0bd37-60af-4206-943e-0a6726ada309): created successfully
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac793799-5c43-4fd5-a21c-0c53d2647b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Flow 'volume_create_manager' (35359053-b1c2-4d44-9de1-86da2d0d1dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4743da6c-1cc2-4f27-bffd-14385c7d34ac tempest-VolumesDeleteCascade-167942625 None] Created volume successfully.
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Flow 'volume_create_manager' (641cd529-8ca0-407d-b9cc-a66289ba9120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5f7052-da62-465f-a51c-138146da1713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5f7052-da62-465f-a51c-138146da1713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1516127278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f7a7f93b-2a62-4c6c-b032-30576a5c749b,host='devstack@QuobyteHD#QuobyteHD',id=e27cd8ea-9205-4772-8679-25caa6f8c2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229869a24ea044dca7d76e64164d4eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:02Z,use_quota=True,user_id='c8958806d4b44f55b2d32886088e28f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d73ac3d-6c93-47f3-b00b-172b930ef10b),volume_type_id=5d73ac3d-6c93-47f3-b00b-172b930ef10b)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe43dfd-5a2e-46ec-be96-66e226b761cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe43dfd-5a2e-46ec-be96-66e226b761cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdb210d-b49b-45f5-8759-f77190fd3706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdb210d-b49b-45f5-8759-f77190fd3706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27cd8ea-9205-4772-8679-25caa6f8c2f7', 'volume_name': 'volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0c8a4c-42bd-4562-b0c9-4987c33b54b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0c8a4c-42bd-4562-b0c9-4987c33b54b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba324c8-be5d-466b-ac62-18633b4386b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:02 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Volume e27cd8ea-9205-4772-8679-25caa6f8c2f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7', 'volume_size': 1}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f7a7f93b-2a62-4c6c-b032-30576a5c749b,created_at=2026-11-07T01:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1516127278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f7a7f93b-2a62-4c6c-b032-30576a5c749b,host='devstack@QuobyteHD#QuobyteHD',id=e27cd8ea-9205-4772-8679-25caa6f8c2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229869a24ea044dca7d76e64164d4eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:02Z,use_quota=True,user_id='c8958806d4b44f55b2d32886088e28f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d73ac3d-6c93-47f3-b00b-172b930ef10b),volume_type_id=5d73ac3d-6c93-47f3-b00b-172b930ef10b)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Creating volume e27cd8ea-9205-4772-8679-25caa6f8c2f7 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:35:02 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:02 devstack sudo[92106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7 1073741824
Nov 07 02:35:02 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:02 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7 1073741824" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:02 devstack sudo[92112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7
Nov 07 02:35:02 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:02 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7" returned: 0 in 0.308s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba324c8-be5d-466b-ac62-18633b4386b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2373d89-b132-4955-9aa5-360159fc2de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:03 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Volume volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7 (e27cd8ea-9205-4772-8679-25caa6f8c2f7): created successfully
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2373d89-b132-4955-9aa5-360159fc2de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Flow 'volume_create_manager' (641cd529-8ca0-407d-b9cc-a66289ba9120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-044a1047-fd18-43fb-8852-d775f20d24b3 tempest-GroupsTest-589894907 None] Created volume successfully.
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] Creating offline snapshot 54101f5c-e793-4aff-a7c7-509601bb39ea of volume f7e0bd37-60af-4206-943e-0a6726ada309 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab698ad-e2ea-40f5-8216-bb2d16cf298c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:03 devstack sudo[92115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309
Nov 07 02:35:03 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:03 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309" returned: 0 in 0.404s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:03 devstack sudo[92120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea 1G
Nov 07 02:35:03 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Flow 'volume_create_manager' (5892e158-b3fc-40e1-91cd-ec4f12949204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa556ab-cc17-4d37-a353-cc3bc6538235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa556ab-cc17-4d37-a353-cc3bc6538235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1742313990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f7a7f93b-2a62-4c6c-b032-30576a5c749b,host='devstack@QuobyteHD#QuobyteHD',id=b94b1e57-d905-4270-a2cb-718065b0faec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229869a24ea044dca7d76e64164d4eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:04Z,use_quota=True,user_id='c8958806d4b44f55b2d32886088e28f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d73ac3d-6c93-47f3-b00b-172b930ef10b),volume_type_id=5d73ac3d-6c93-47f3-b00b-172b930ef10b)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71a20df-dc82-42ce-b899-d7dab479e4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71a20df-dc82-42ce-b899-d7dab479e4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08ad831-c4b0-4cff-ba52-ed4abbf3e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08ad831-c4b0-4cff-ba52-ed4abbf3e238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94b1e57-d905-4270-a2cb-718065b0faec', 'volume_name': 'volume-b94b1e57-d905-4270-a2cb-718065b0faec', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8b3cd0-6859-426c-af13-d812f0025005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8b3cd0-6859-426c-af13-d812f0025005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b542472b-ff49-4143-b104-fdc4edf7580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:04 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Volume b94b1e57-d905-4270-a2cb-718065b0faec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94b1e57-d905-4270-a2cb-718065b0faec', 'volume_size': 1}
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:04 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea 1G" returned: 0 in 0.439s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e0bd37-60af-4206-943e-0a6726ada309 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:04 devstack sudo[92127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e0bd37-60af-4206-943e-0a6726ada309 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea
Nov 07 02:35:04 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:04 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e0bd37-60af-4206-943e-0a6726ada309 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea" returned: 0 in 0.305s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:04 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea is being set with open permissions: ugo+rw
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:04 devstack sudo[92132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea
Nov 07 02:35:04 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:04 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea" returned: 0 in 0.270s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:04 devstack sudo[92135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.info
Nov 07 02:35:04 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:04 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.info" returned: 0 in 0.281s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:04 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.info is being set with open permissions: ugo+rw
Nov 07 02:35:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:05 devstack sudo[92139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.info
Nov 07 02:35:05 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-c5bdaa00-042b-4b97-a253-8b0f47e9875e req-c7f6df3c-6a7d-439d-8f69-a9933e194eb5 tempest-ServerActionsTestOtherA-661875350 None] Terminate volume connection completed successfully.
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-c5bdaa00-042b-4b97-a253-8b0f47e9875e req-c7f6df3c-6a7d-439d-8f69-a9933e194eb5 tempest-ServerActionsTestOtherA-661875350 None] Deleting attachment b7dfee1c-1dce-4b7d-80f5-72a522afa419. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:35:05 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.info" returned: 0 in 0.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f7a7f93b-2a62-4c6c-b032-30576a5c749b,created_at=2026-11-07T01:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1742313990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f7a7f93b-2a62-4c6c-b032-30576a5c749b,host='devstack@QuobyteHD#QuobyteHD',id=b94b1e57-d905-4270-a2cb-718065b0faec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229869a24ea044dca7d76e64164d4eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:04Z,use_quota=True,user_id='c8958806d4b44f55b2d32886088e28f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d73ac3d-6c93-47f3-b00b-172b930ef10b),volume_type_id=5d73ac3d-6c93-47f3-b00b-172b930ef10b)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Creating volume b94b1e57-d905-4270-a2cb-718065b0faec {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:35:05 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:05 devstack sudo[92145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec 1073741824
Nov 07 02:35:05 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-55940109-d381-4872-abad-9e1617be8b76 tempest-VolumesDeleteCascade-167942625 None] Create snapshot completed successfully
Nov 07 02:35:05 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec 1073741824" returned: 0 in 0.453s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:05 devstack sudo[92150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec
Nov 07 02:35:05 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:06 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec" returned: 0 in 0.261s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:35:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b542472b-ff49-4143-b104-fdc4edf7580c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94b1e57-d905-4270-a2cb-718065b0faec', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74b789d-45a2-4c50-b63d-1f5babd68b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:06 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Volume volume-b94b1e57-d905-4270-a2cb-718065b0faec (b94b1e57-d905-4270-a2cb-718065b0faec): created successfully
Nov 07 02:35:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74b789d-45a2-4c50-b63d-1f5babd68b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Flow 'volume_create_manager' (5892e158-b3fc-40e1-91cd-ec4f12949204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-83741de7-d430-4cd6-a8b4-de0505dd01bd tempest-GroupsTest-589894907 None] Created volume successfully.
Nov 07 02:35:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-53bef97e-2d87-449b-8b39-09193bdf46a2 tempest-GroupsTest-589894907 None] Update group completed successfully.
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Flow 'volume_create_manager' (25217d16-c36a-45ed-9be6-1b7e2cb8ac41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e36c348-6aeb-49a5-bb5d-441e3c8b73c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e36c348-6aeb-49a5-bb5d-441e3c8b73c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1800009576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c94e422-f673-4762-8d4e-15ed5920022c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951a5274abe14fef93f1f8981304a5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=54101f5c-e793-4aff-a7c7-509601bb39ea,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:07Z,use_quota=True,user_id='3db436f854624e5c8ebd869c4b38e963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8ce972-c7ee-412d-a847-3b55715ee1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8ce972-c7ee-412d-a847-3b55715ee1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44635eee-c909-4376-80f3-2d8108e11655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44635eee-c909-4376-80f3-2d8108e11655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c94e422-f673-4762-8d4e-15ed5920022c', 'volume_name': 'volume-4c94e422-f673-4762-8d4e-15ed5920022c', 'volume_size': 1, 'snapshot_id': '54101f5c-e793-4aff-a7c7-509601bb39ea'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43202e12-0ed7-4ed8-b15d-c665e4f68d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43202e12-0ed7-4ed8-b15d-c665e4f68d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1198e786-f9fc-4f83-92da-7fc06f52f6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Volume 4c94e422-f673-4762-8d4e-15ed5920022c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c94e422-f673-4762-8d4e-15ed5920022c', 'volume_size': 1, 'snapshot_id': '54101f5c-e793-4aff-a7c7-509601bb39ea'}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-quobyte-54101f5c-e793-4aff-a7c7-509601bb39ea-4c94e422-f673-4762-8d4e-15ed5920022c" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-54101f5c-e793-4aff-a7c7-509601bb39ea-4c94e422-f673-4762-8d4e-15ed5920022c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Creating volume 4c94e422-f673-4762-8d4e-15ed5920022c from snapshot 54101f5c-e793-4aff-a7c7-509601bb39ea {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-quobyte-4c94e422-f673-4762-8d4e-15ed5920022c" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-4c94e422-f673-4762-8d4e-15ed5920022c" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] snapshot: 54101f5c-e793-4aff-a7c7-509601bb39ea, volume: 4c94e422-f673-4762-8d4e-15ed5920022c,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef9ca90-bda3-4f5c-b06a-636897d79385]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:07 devstack sudo[92178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea
Nov 07 02:35:07 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:07 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea" returned: 0 in 0.478s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7e0bd37-60af-4206-943e-0a6726ada309(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b34f7a-147a-4cdd-a8ed-7afecf05d9c5]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b9a5713c-6169-439e-ab9d-ad8d37f42163 tempest-GroupsTest-589894907 None] Update group completed successfully.
Nov 07 02:35:07 devstack sudo[92185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309
Nov 07 02:35:07 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:08 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309" returned: 0 in 0.414s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:35:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:35:08 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:35:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:08 devstack sudo[92191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c
Nov 07 02:35:08 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Acquiring lock "cinder-quobyte-b94b1e57-d905-4270-a2cb-718065b0faec" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Lock "cinder-quobyte-b94b1e57-d905-4270-a2cb-718065b0faec" acquired by "delete_volume" :: waited 0.055s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4589cf1-eeea-49cd-913f-4c8d4698122d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:11 devstack sudo[92205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec
Nov 07 02:35:11 devstack sudo[92205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:11 devstack sudo[92205]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec" returned: 0 in 0.865s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:11 devstack sudo[92212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec
Nov 07 02:35:11 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:12 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b94b1e57-d905-4270-a2cb-718065b0faec" returned: 0 in 0.565s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Lock "cinder-quobyte-b94b1e57-d905-4270-a2cb-718065b0faec" released by "delete_volume" :: held 1.578s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Acquiring lock "cinder-quobyte-e27cd8ea-9205-4772-8679-25caa6f8c2f7" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Lock "cinder-quobyte-e27cd8ea-9205-4772-8679-25caa6f8c2f7" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:12 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3add9cf-41ff-4ef2-86f6-c2b81caa9ac2]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:12 devstack sudo[92216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7
Nov 07 02:35:12 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:13 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7" returned: 0 in 0.901s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:13 devstack sudo[92242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7
Nov 07 02:35:13 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:13 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e27cd8ea-9205-4772-8679-25caa6f8c2f7" returned: 0 in 0.525s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Lock "cinder-quobyte-e27cd8ea-9205-4772-8679-25caa6f8c2f7" released by "delete_volume" :: held 1.586s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:13 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Created reservations ['3fa72647-95e8-488b-ac75-26199d8e9541'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:14 devstack cinder-volume[87087]: WARNING cinder.quota [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-499414330 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-499414330, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:35:14 devstack cinder-volume[87087]: WARNING cinder.quota [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-499414330 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-499414330, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:35:14 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Created reservations ['a563e094-73fd-47c0-9b37-a374c2b8f556', 'ab25d6b0-21f7-48dc-be1d-3046613f2c16', '2ce51028-00d1-4345-9ffd-1a2c92a693aa', '94c5ee14-1112-4739-8a1e-dd00c4491410'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:14 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Created reservations ['4aa43bea-594d-438d-af92-79ed2dec78da', '742c975f-c3f4-42b3-abd6-106bff309170', 'a3bdae53-d973-4790-9536-d945bc05b2b5', '2b8dcecf-e7d5-4cd5-8e78-4586b77d18a2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:14 devstack sudo[92249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:35:14 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:15 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:35:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Flow 'volume_create_manager' (b39f54c6-a37d-4ac7-8146-174ffd5f64d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b653ba9-b1e5-4295-b3ef-29e695854d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b653ba9-b1e5-4295-b3ef-29e695854d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-98040115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43827228-c6ce-478c-ba02-ce41698ff070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbde3fd50b7411fb90b7dfa2f6ad5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:15Z,use_quota=True,user_id='59d77445c6944a868d4f479dae695fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321cf1d6-14d8-4de8-866d-6aca11041a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321cf1d6-14d8-4de8-866d-6aca11041a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf0fbe9-bfcd-4bb9-adb2-92aae8333347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:15 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:35:15 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.679s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:15 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:35:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6ad309bb-8e9e-42e6-896a-801f5cfc25d2 tempest-GroupsTest-589894907 None] Delete group completed successfully.
Nov 07 02:35:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf0fbe9-bfcd-4bb9-adb2-92aae8333347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43827228-c6ce-478c-ba02-ce41698ff070', 'volume_name': 'volume-43827228-c6ce-478c-ba02-ce41698ff070', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb7b5640>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d297cfe-96f6-43c8-bd4f-29f0c2724758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d297cfe-96f6-43c8-bd4f-29f0c2724758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e81ac9-023b-4b41-b4e6-c67759c1bf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Volume 43827228-c6ce-478c-ba02-ce41698ff070: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43827228-c6ce-478c-ba02-ce41698ff070', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb7b5640>}
Nov 07 02:35:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Trying to clone 43827228-c6ce-478c-ba02-ce41698ff070 from image e17a9067-5798-44ad-877c-38fbc4f9665f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:35:17 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:35:17 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Image download 20.69 MB at 20.69 MB/s
Nov 07 02:35:17 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f58d65-d3c4-451d-a1cd-f79053fa4025]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:17 devstack sudo[92278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD
Nov 07 02:35:17 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:17 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:17 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Temporary image e17a9067-5798-44ad-877c-38fbc4f9665f is fetched for user 59d77445c6944a868d4f479dae695fa9. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[af28e805-1e4b-4b0f-84fa-82ef217f827d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:18 devstack sudo[92283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD
Nov 07 02:35:18 devstack sudo[92283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:18 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c" returned: 0 in 10.207s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309, size 1024.00 MB, duration 10.21 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:35:18 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Converted 1024.00 MB image at 100.30 MB/s
Nov 07 02:35:18 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c is being set with open permissions: ugo+rw
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:18 devstack sudo[92285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c
Nov 07 02:35:18 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:18 devstack sudo[92283]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:18 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c" returned: 0 in 0.302s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-4c94e422-f673-4762-8d4e-15ed5920022c" released by "_copy_volume_from_snapshot" :: held 11.514s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-54101f5c-e793-4aff-a7c7-509601bb39ea-4c94e422-f673-4762-8d4e-15ed5920022c" released by "_create_volume_from_snapshot" :: held 11.616s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.638s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-98040115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43827228-c6ce-478c-ba02-ce41698ff070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbde3fd50b7411fb90b7dfa2f6ad5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:15Z,use_quota=True,user_id='59d77445c6944a868d4f479dae695fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Creating volume 43827228-c6ce-478c-ba02-ce41698ff070 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:35:18 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:18 devstack sudo[92292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070 1073741824
Nov 07 02:35:18 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1198e786-f9fc-4f83-92da-7fc06f52f6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c94e422-f673-4762-8d4e-15ed5920022c', 'volume_size': 1, 'snapshot_id': '54101f5c-e793-4aff-a7c7-509601bb39ea'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8d5d35-99aa-454c-8c78-a882b757f809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:19 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Volume volume-4c94e422-f673-4762-8d4e-15ed5920022c (4c94e422-f673-4762-8d4e-15ed5920022c): created successfully
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8d5d35-99aa-454c-8c78-a882b757f809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Flow 'volume_create_manager' (25217d16-c36a-45ed-9be6-1b7e2cb8ac41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c2601723-f175-4c42-8928-d1e3c82bfa11 tempest-VolumesDeleteCascade-167942625 None] Created volume successfully.
Nov 07 02:35:19 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070 1073741824" returned: 0 in 0.545s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:19 devstack sudo[92298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070
Nov 07 02:35:19 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-f7e0bd37-60af-4206-943e-0a6726ada309-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:19 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-f7e0bd37-60af-4206-943e-0a6726ada309-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070" returned: 0 in 0.342s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Acquiring lock "cinder-44266b5d-3c0a-4fd0-845a-cfd722a722c0-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Attempting download of e17a9067-5798-44ad-877c-38fbc4f9665f ((None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}])) to volume 43827228-c6ce-478c-ba02-ce41698ff070. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Performing cascade delete. {{(pid=87087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-54101f5c-e793-4aff-a7c7-509601bb39ea-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Lock "cinder-44266b5d-3c0a-4fd0-845a-cfd722a722c0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-54101f5c-e793-4aff-a7c7-509601bb39ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4079f36-818d-4eb6-b9c0-ae1aeb34813d]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_4hpfngms {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-quobyte-f7e0bd37-60af-4206-943e-0a6726ada309" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Acquiring lock "cinder-quobyte-44266b5d-3c0a-4fd0-845a-cfd722a722c0" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-f7e0bd37-60af-4206-943e-0a6726ada309" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-quobyte-54101f5c-e793-4aff-a7c7-509601bb39ea" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Lock "cinder-quobyte-44266b5d-3c0a-4fd0-845a-cfd722a722c0" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-54101f5c-e793-4aff-a7c7-509601bb39ea" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Deleting offline snapshot 54101f5c-e793-4aff-a7c7-509601bb39ea of volume f7e0bd37-60af-4206-943e-0a6726ada309 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] snapshot_file for this snap is: volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16e340d-0794-4a51-92e6-d03074ec9207]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9190decb-5cf4-4526-b125-5cb0255e1cb7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:20 devstack sudo[92301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_4hpfngms
Nov 07 02:35:20 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:20 devstack sudo[92302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0
Nov 07 02:35:20 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:20 devstack sudo[92303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea
Nov 07 02:35:20 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:20 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_4hpfngms" returned: 0 in 0.415s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_4hpfngms {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:20 devstack sudo[92309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_4hpfngms
Nov 07 02:35:20 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:20 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0" returned: 0 in 0.542s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:20 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea" returned: 0 in 0.543s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7e0bd37-60af-4206-943e-0a6726ada309(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:20 devstack sudo[92318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0
Nov 07 02:35:20 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf73daa0-685f-49cb-a44b-166644b12bf7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:20 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_4hpfngms" returned: 1 in 0.406s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_4hpfngms' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2985966-ca49-4e54-9c02-5fb70893632f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:20 devstack sudo[92320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309
Nov 07 02:35:20 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:20 devstack sudo[92323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD
Nov 07 02:35:20 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:20 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44266b5d-3c0a-4fd0-845a-cfd722a722c0" returned: 0 in 0.339s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Lock "cinder-quobyte-44266b5d-3c0a-4fd0-845a-cfd722a722c0" released by "delete_volume" :: held 0.988s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Created reservations ['f97880bd-89dc-4efb-8e34-39b7efee025b', 'df939b7b-eedd-4471-a467-dc1b886c7372', 'ff237b4e-91b9-4dfe-abe8-f57d21874ed5', '372c1dda-12d1-4c0a-968f-ceba75ae034f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:21 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] e17a9067-5798-44ad-877c-38fbc4f9665f was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:21 devstack sudo[92332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070
Nov 07 02:35:21 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:21 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309" returned: 0 in 0.665s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:21 devstack sudo[92335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:35:21 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:21 devstack sudo[92337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea
Nov 07 02:35:21 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:21 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.337s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:35:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Deleted volume successfully.
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c42e424-d7c2-4367-bfff-d7f96768a549 tempest-AttachVolumeShelveTestJSON-276934388 None] Lock "cinder-44266b5d-3c0a-4fd0-845a-cfd722a722c0-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:21 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea" returned: 0 in 0.484s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:21 devstack sudo[92352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea
Nov 07 02:35:21 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:22 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309.54101f5c-e793-4aff-a7c7-509601bb39ea" returned: 0 in 0.274s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-54101f5c-e793-4aff-a7c7-509601bb39ea" released by "_delete_snapshot" :: held 2.112s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-f7e0bd37-60af-4206-943e-0a6726ada309" released by "delete_snapshot" :: held 2.166s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Created reservations ['39e0bc2a-4dd5-430e-a9d7-4216b5c01392', 'f82fd7e9-e844-42f7-9ca2-2e169721ac4a', '3cbb232d-9dde-4351-af59-8aa2683bf103', '211066f7-ecfd-4f54-84d9-6325ee56d27d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Delete snapshot completed successfully.
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-54101f5c-e793-4aff-a7c7-509601bb39ea-delete_snapshot" released by "delete_snapshot" :: held 2.425s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Snapshots deleted, issuing volume delete {{(pid=87087) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-quobyte-f7e0bd37-60af-4206-943e-0a6726ada309" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-f7e0bd37-60af-4206-943e-0a6726ada309" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dad1bf-1958-4f11-9557-2b658909f051]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:22 devstack sudo[92355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309
Nov 07 02:35:22 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:22 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309" returned: 0 in 0.474s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:22 devstack sudo[92361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309
Nov 07 02:35:22 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:23 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f7e0bd37-60af-4206-943e-0a6726ada309" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-f7e0bd37-60af-4206-943e-0a6726ada309" released by "delete_volume" :: held 0.932s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Created reservations ['1b7dbb91-202d-4aab-956c-65fc06830fd0', '6aa63ce4-2d73-459c-b8bd-9d90a8acab4a', '340298f2-c142-4027-b882-242e2f6095f6', '40d2dde6-aaed-40e0-874a-54babf5341f6'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:23 devstack sudo[92364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:35:23 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:23 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070" returned: 0 in 2.429s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_6t82v2icdevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:35:23 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Converted 112.00 MB image at 46.06 MB/s
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:23 devstack sudo[92366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070 1G
Nov 07 02:35:23 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:23 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.306s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:35:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Deleted volume successfully.
Nov 07 02:35:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-50748663-63f3-4783-9cfd-dcb3ef20cf55 tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-f7e0bd37-60af-4206-943e-0a6726ada309-delete_volume" released by "delete_volume" :: held 3.997s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:24 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070 1G" returned: 0 in 0.425s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Downloaded image e17a9067-5798-44ad-877c-38fbc4f9665f ((None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}])) to volume 43827228-c6ce-478c-ba02-ce41698ff070 successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Temporary image e17a9067-5798-44ad-877c-38fbc4f9665f for user 59d77445c6944a868d4f479dae695fa9 is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Marking volume 43827228-c6ce-478c-ba02-ce41698ff070 as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Copying metadata from image e17a9067-5798-44ad-877c-38fbc4f9665f to 43827228-c6ce-478c-ba02-ce41698ff070. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Creating volume glance metadata for volume 43827228-c6ce-478c-ba02-ce41698ff070 backed by image e17a9067-5798-44ad-877c-38fbc4f9665f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e81ac9-023b-4b41-b4e6-c67759c1bf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43827228-c6ce-478c-ba02-ce41698ff070', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb7b5640>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f15046-942b-41ad-9dbf-7e0a3550abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Volume volume-43827228-c6ce-478c-ba02-ce41698ff070 (43827228-c6ce-478c-ba02-ce41698ff070): created successfully
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f15046-942b-41ad-9dbf-7e0a3550abb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Flow 'volume_create_manager' (b39f54c6-a37d-4ac7-8146-174ffd5f64d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-859f4734-754f-4dd8-afd3-3fd7201d1e53 tempest-ServerActionsTestOtherA-661875350 None] Created volume successfully.
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-4c94e422-f673-4762-8d4e-15ed5920022c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-4c94e422-f673-4762-8d4e-15ed5920022c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "cinder-quobyte-4c94e422-f673-4762-8d4e-15ed5920022c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-4c94e422-f673-4762-8d4e-15ed5920022c" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f274678-2c5a-4c10-91c9-74ebd7c38879]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:24 devstack sudo[92374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c
Nov 07 02:35:24 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Flow 'volume_create_manager' (0180b493-c16b-48ce-88ea-cf75a9f31059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34174a6f-db5c-4a2a-a968-c4f60a223366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:25 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c" returned: 0 in 0.436s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34174a6f-db5c-4a2a-a968-c4f60a223366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1707234826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdd24dde29048a2b483bf5db92b13b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:25Z,use_quota=True,user_id='7b706c42657a4237ac96fd425646f9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5eac5eb-763f-4d95-bb6e-936f9906a58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5eac5eb-763f-4d95-bb6e-936f9906a58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:25 devstack sudo[92380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c
Nov 07 02:35:25 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb78d4a-1639-420c-a326-72971a00c3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb78d4a-1639-420c-a326-72971a00c3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431', 'volume_name': 'volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa0a34a-d639-408e-8ba1-8ef6f0d99334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa0a34a-d639-408e-8ba1-8ef6f0d99334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f10069-4eb8-4a8b-ad4a-ae28f964993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431', 'volume_size': 1}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1707234826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdd24dde29048a2b483bf5db92b13b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:25Z,use_quota=True,user_id='7b706c42657a4237ac96fd425646f9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Creating volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:35:25 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:25 devstack sudo[92382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 1073741824
Nov 07 02:35:25 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:25 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c94e422-f673-4762-8d4e-15ed5920022c" returned: 0 in 0.334s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-quobyte-4c94e422-f673-4762-8d4e-15ed5920022c" released by "delete_volume" :: held 0.843s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Created reservations ['e0962457-0cf7-4e16-bc6a-82d13d3de5fc', '07306f13-9926-4230-86eb-deea84d324d7', 'ced97513-9042-4c7a-ae2e-51d107fd561a', 'e315a0ba-c298-45f0-8b22-7d14d583dbac'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:25 devstack sudo[92390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:35:25 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:25 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 1073741824" returned: 0 in 0.701s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:26 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.330s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:26 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:35:26 devstack sudo[92393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431
Nov 07 02:35:26 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Deleted volume successfully.
Nov 07 02:35:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-354773e3-ff85-493c-a4a8-98b548d9926d tempest-VolumesDeleteCascade-167942625 None] Lock "cinder-4c94e422-f673-4762-8d4e-15ed5920022c-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:26 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" returned: 0 in 0.356s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:35:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f10069-4eb8-4a8b-ad4a-ae28f964993f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c170b5c-5ec7-42ad-a24f-5e25fab1a7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Volume volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 (49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431): created successfully
Nov 07 02:35:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c170b5c-5ec7-42ad-a24f-5e25fab1a7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Flow 'volume_create_manager' (0180b493-c16b-48ce-88ea-cf75a9f31059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8d3eb088-6e76-49ab-8e12-b2d393a4105c tempest-SnapshotsActionsTest-454374358 None] Created volume successfully.
Nov 07 02:35:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] Creating offline snapshot 848ebc26-a7fd-4a22-9f6f-824cdf81668e of volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:35:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[11326e99-2008-464a-aea7-ee30a030495a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:27 devstack sudo[92402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431
Nov 07 02:35:27 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:28 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" returned: 0 in 0.573s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:28 devstack sudo[92410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e 1G
Nov 07 02:35:28 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4e8b6992-fe75-48c2-85cd-36fef6248f48 req-00f7bd56-40b7-4317-9224-a8c573072978 tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:29 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e 1G" returned: 0 in 0.812s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:29 devstack sudo[92462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:35:29 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:29 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.548s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:29 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e is being set with open permissions: ugo+rw
Nov 07 02:35:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:29 devstack sudo[92467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:35:29 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:29 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:30 devstack sudo[92470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.info
Nov 07 02:35:30 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:30 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.info" returned: 0 in 0.421s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:30 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.info is being set with open permissions: ugo+rw
Nov 07 02:35:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:30 devstack sudo[92473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.info
Nov 07 02:35:30 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:30 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.info" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.198s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4e8b6992-fe75-48c2-85cd-36fef6248f48 req-00f7bd56-40b7-4317-9224-a8c573072978 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.067s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4e8b6992-fe75-48c2-85cd-36fef6248f48 req-00f7bd56-40b7-4317-9224-a8c573072978 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-babe0c87-6333-44fc-87ee-fe0affa76db1 tempest-SnapshotsActionsTest-454374358 None] Create snapshot completed successfully
Nov 07 02:35:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4e8b6992-fe75-48c2-85cd-36fef6248f48 req-00f7bd56-40b7-4317-9224-a8c573072978 tempest-ServerActionsTestOtherA-661875350 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-43827228-c6ce-478c-ba02-ce41698ff070', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '072430c4-2205-443d-9e33-b54434f05dd7', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:35:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-4e8b6992-fe75-48c2-85cd-36fef6248f48 req-00f7bd56-40b7-4317-9224-a8c573072978 tempest-ServerActionsTestOtherA-661875350 None] attachment_update completed successfully.
Nov 07 02:35:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] Creating offline snapshot 720d2411-21f2-434e-bdb5-27c93899bc93 of volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:35:33 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4925a5d5-523c-4655-bcce-6b69a06f1f2f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:33 devstack sudo[92923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:35:33 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:33 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.751s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:34 devstack sudo[92943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93 1G
Nov 07 02:35:34 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Flow 'volume_create_manager' (105e8252-d477-4bb7-bfd7-48f9c1a0108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce97ab5b-7093-4688-890a-fd40c676bcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce97ab5b-7093-4688-890a-fd40c676bcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-285427682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5466d6bf-f11d-4e93-91f2-92687a38a0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='141218f73ab84569a723cc2148b60411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:35Z,use_quota=True,user_id='ead6e87a69eb4db8963fedd8d9353073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5fc907-f6c3-42ba-b6c9-25eff6666001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5fc907-f6c3-42ba-b6c9-25eff6666001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb789b84-2f93-439d-9425-b7810865622b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb789b84-2f93-439d-9425-b7810865622b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5466d6bf-f11d-4e93-91f2-92687a38a0e5', 'volume_name': 'volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70c14e6-4fef-4baf-a23e-f49a96bd0fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70c14e6-4fef-4baf-a23e-f49a96bd0fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7069c02f-cac1-472f-9e0e-e158e99bcaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Volume 5466d6bf-f11d-4e93-91f2-92687a38a0e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5', 'volume_size': 1}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:34 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93 1G" returned: 0 in 0.953s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:34 devstack sudo[92954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93
Nov 07 02:35:34 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:35 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93" returned: 0 in 0.481s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:35 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93 is being set with open permissions: ugo+rw
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:35 devstack sudo[92959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93
Nov 07 02:35:35 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:35 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93" returned: 0 in 0.275s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-285427682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5466d6bf-f11d-4e93-91f2-92687a38a0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='141218f73ab84569a723cc2148b60411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:35Z,use_quota=True,user_id='ead6e87a69eb4db8963fedd8d9353073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Creating volume 5466d6bf-f11d-4e93-91f2-92687a38a0e5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:35:35 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:35:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:35 devstack sudo[92962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 1073741824
Nov 07 02:35:35 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5a419571-3581-4f8e-9160-c838d49d5954 tempest-SnapshotsActionsTest-454374358 None] Create snapshot completed successfully
Nov 07 02:35:36 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 1073741824" returned: 0 in 0.632s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-720d2411-21f2-434e-bdb5-27c93899bc93-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:36 devstack sudo[92968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5
Nov 07 02:35:36 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-720d2411-21f2-434e-bdb5-27c93899bc93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-quobyte-720d2411-21f2-434e-bdb5-27c93899bc93" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-720d2411-21f2-434e-bdb5-27c93899bc93" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Deleting offline snapshot 720d2411-21f2-434e-bdb5-27c93899bc93 of volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] snapshot_file for this snap is: volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f9edce-09ab-4604-a2a9-bc7d435d8092]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:36 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5" returned: 0 in 0.381s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7069c02f-cac1-472f-9e0e-e158e99bcaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2309e03-e5ca-4ff4-b540-1bdfb394f8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:36 devstack sudo[92970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93
Nov 07 02:35:36 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Volume volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 (5466d6bf-f11d-4e93-91f2-92687a38a0e5): created successfully
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2309e03-e5ca-4ff4-b540-1bdfb394f8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Flow 'volume_create_manager' (105e8252-d477-4bb7-bfd7-48f9c1a0108c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-4b0fe908-f991-494c-ac87-d94e4d6381c6 req-d25f02c6-7d95-49f8-b979-606a7dbef7dd tempest-VolumesSnapshotsTestJSON-641721044 None] Created volume successfully.
Nov 07 02:35:37 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93" returned: 0 in 0.617s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb9af3b-7d97-4e8d-85fd-810d235786b4]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:37 devstack sudo[92977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:35:37 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] Creating offline snapshot a14c5294-5107-4c8d-8aa8-14d0e022856b of volume 5466d6bf-f11d-4e93-91f2-92687a38a0e5 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:35:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3479d50-e78b-492d-ba86-5b47813ba6ab]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:38 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.804s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:38 devstack sudo[92984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93
Nov 07 02:35:38 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:38 devstack sudo[92981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5
Nov 07 02:35:38 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Flow 'volume_create_manager' (26568acc-0b0e-4ee6-98f6-00918fc4b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b29f63-7bb7-4502-b2ec-46d7f1ab680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b29f63-7bb7-4502-b2ec-46d7f1ab680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-580596101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70174791-b3db-497f-a2ec-15f5c2b1393d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ee748d14e5440c8f9b8ea90ed2ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:38Z,use_quota=True,user_id='547a718bf41e4da6af60ae260ec7b40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ccdb24-dd41-430f-9020-a2d83b4cb708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ccdb24-dd41-430f-9020-a2d83b4cb708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262221e4-b406-44c6-95c6-7e5213a3775f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262221e4-b406-44c6-95c6-7e5213a3775f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70174791-b3db-497f-a2ec-15f5c2b1393d', 'volume_name': 'volume-70174791-b3db-497f-a2ec-15f5c2b1393d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f512cd-bf17-4858-bf29-0b5fad1798bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f512cd-bf17-4858-bf29-0b5fad1798bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b36bf0a-6489-4765-99f6-8bc824d50059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Volume 70174791-b3db-497f-a2ec-15f5c2b1393d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70174791-b3db-497f-a2ec-15f5c2b1393d', 'volume_size': 1}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:38 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5" returned: 0 in 1.013s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:38 devstack sudo[92999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b 1G
Nov 07 02:35:38 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:39 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93" returned: 0 in 0.815s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:39 devstack sudo[93001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93
Nov 07 02:35:39 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:39 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.720d2411-21f2-434e-bdb5-27c93899bc93" returned: 0 in 0.489s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-720d2411-21f2-434e-bdb5-27c93899bc93" released by "_delete_snapshot" :: held 2.900s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" released by "delete_snapshot" :: held 2.940s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:39 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b 1G" returned: 0 in 0.693s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:39 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Created reservations ['543925c7-bda9-4826-a71f-f6e7b0a5de97', 'db2568ed-821b-44ee-be77-66651f2a36a9', '4690b325-2127-4ca8-9924-1f032f9f7beb', '451a83f0-4e23-41d1-a925-3582cad62d6c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:39 devstack sudo[93010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b
Nov 07 02:35:39 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Delete snapshot completed successfully.
Nov 07 02:35:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-601aecb8-64f9-4be9-9e27-163d0655cd02 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-720d2411-21f2-434e-bdb5-27c93899bc93-delete_snapshot" released by "delete_snapshot" :: held 3.286s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:40 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b" returned: 0 in 0.649s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:40 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b is being set with open permissions: ugo+rw
Nov 07 02:35:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:40 devstack sudo[93015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b
Nov 07 02:35:40 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:40 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b" returned: 0 in 0.434s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:40 devstack sudo[93019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.info
Nov 07 02:35:40 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:41 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.info" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:41 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.info is being set with open permissions: ugo+rw
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:41 devstack sudo[93022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.info
Nov 07 02:35:41 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:41 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.info" returned: 0 in 0.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.561s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.571s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-580596101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70174791-b3db-497f-a2ec-15f5c2b1393d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ee748d14e5440c8f9b8ea90ed2ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:38Z,use_quota=True,user_id='547a718bf41e4da6af60ae260ec7b40d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Creating volume 70174791-b3db-497f-a2ec-15f5c2b1393d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:35:41 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:35:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:41 devstack sudo[93025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d 1073741824
Nov 07 02:35:41 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-cc204c87-40fb-4abb-a070-425374b4df9f req-35f4d294-a74d-4fbf-9f70-e4692993e8c1 tempest-VolumesSnapshotsTestJSON-641721044 None] Create snapshot completed successfully
Nov 07 02:35:42 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d 1073741824" returned: 0 in 0.628s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:42 devstack sudo[93032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d
Nov 07 02:35:42 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Acquiring lock "cinder-a14c5294-5107-4c8d-8aa8-14d0e022856b-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "cinder-a14c5294-5107-4c8d-8aa8-14d0e022856b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Acquiring lock "cinder-quobyte-5466d6bf-f11d-4e93-91f2-92687a38a0e5" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "cinder-quobyte-5466d6bf-f11d-4e93-91f2-92687a38a0e5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Acquiring lock "cinder-quobyte-a14c5294-5107-4c8d-8aa8-14d0e022856b" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "cinder-quobyte-a14c5294-5107-4c8d-8aa8-14d0e022856b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Deleting offline snapshot a14c5294-5107-4c8d-8aa8-14d0e022856b of volume 5466d6bf-f11d-4e93-91f2-92687a38a0e5 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] snapshot_file for this snap is: volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[607144b1-894f-4796-a57e-ae794f97a0ab]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:42 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d" returned: 0 in 0.439s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b36bf0a-6489-4765-99f6-8bc824d50059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70174791-b3db-497f-a2ec-15f5c2b1393d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1937349-ef84-4029-ac75-42daa27bb237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] Creating offline snapshot 59360a12-c8c1-4bb7-9d5b-e70d9c014d36 of volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:35:42 devstack sudo[93036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b
Nov 07 02:35:42 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Volume volume-70174791-b3db-497f-a2ec-15f5c2b1393d (70174791-b3db-497f-a2ec-15f5c2b1393d): created successfully
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1937349-ef84-4029-ac75-42daa27bb237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Flow 'volume_create_manager' (26568acc-0b0e-4ee6-98f6-00918fc4b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e3f69e-f9fd-463a-aaad-0c32f7fe6715]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8042648f-0a3b-453d-9fe5-666d13b9175b tempest-VolumesNegativeTest-1035882956 None] Created volume successfully.
Nov 07 02:35:42 devstack sudo[93038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:35:42 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:43 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b" returned: 0 in 0.516s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbe89dd-9174-4679-b545-8d1a206d3bc8]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:43 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.453s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:43 devstack sudo[93047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36 1G
Nov 07 02:35:43 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:43 devstack sudo[93043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5
Nov 07 02:35:43 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:43 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5" returned: 0 in 0.470s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:43 devstack sudo[93057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b
Nov 07 02:35:43 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:43 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36 1G" returned: 0 in 0.590s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:43 devstack sudo[93059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36
Nov 07 02:35:43 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:44 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b" returned: 0 in 0.659s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:44 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:44 devstack sudo[93067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b
Nov 07 02:35:44 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36" returned: 0 in 0.491s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:44 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36 is being set with open permissions: ugo+rw
Nov 07 02:35:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:44 devstack sudo[93069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36
Nov 07 02:35:44 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:44 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5.a14c5294-5107-4c8d-8aa8-14d0e022856b" returned: 0 in 0.430s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:44 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36" returned: 0 in 0.379s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "cinder-quobyte-a14c5294-5107-4c8d-8aa8-14d0e022856b" released by "_delete_snapshot" :: held 2.298s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "cinder-quobyte-5466d6bf-f11d-4e93-91f2-92687a38a0e5" released by "delete_snapshot" :: held 2.338s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-87d67002-5b68-49ba-93bf-aeb12bb884cd tempest-SnapshotsActionsTest-454374358 None] Create snapshot completed successfully
Nov 07 02:35:44 devstack cinder-volume[87087]: DEBUG cinder.quota [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Created reservations ['8c7a9f46-c2b0-4c54-9e3d-7e3d867998a6', '43aef6fa-f371-465a-9bd5-6b744e4cf61c', 'c75d931c-7c31-44a9-8443-437b240d82da', '0b2702ec-1310-4b49-b7ee-b7d7a499536a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Delete snapshot completed successfully.
Nov 07 02:35:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-479b29cc-d38c-427f-981f-015c18104bcd req-568dc3a1-7b46-469b-b461-861f640d525a tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "cinder-a14c5294-5107-4c8d-8aa8-14d0e022856b-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Acquiring lock "cinder-5466d6bf-f11d-4e93-91f2-92687a38a0e5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "cinder-5466d6bf-f11d-4e93-91f2-92687a38a0e5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Acquiring lock "cinder-quobyte-5466d6bf-f11d-4e93-91f2-92687a38a0e5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "cinder-quobyte-5466d6bf-f11d-4e93-91f2-92687a38a0e5" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[edabe26b-21c7-489d-893a-5e9b108d0237]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:45 devstack sudo[93127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5
Nov 07 02:35:45 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-af25fb2c-64d5-49de-8bc2-55b43a837dfd req-ff8fc5fc-19ea-4963-bf1d-c32549a7fc4a tempest-ServerActionsTestOtherA-661875350 None] Terminate volume connection completed successfully.
Nov 07 02:35:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-af25fb2c-64d5-49de-8bc2-55b43a837dfd req-ff8fc5fc-19ea-4963-bf1d-c32549a7fc4a tempest-ServerActionsTestOtherA-661875350 None] Deleting attachment 072430c4-2205-443d-9e33-b54434f05dd7. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:35:45 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5" returned: 0 in 0.610s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:46 devstack sudo[93137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5
Nov 07 02:35:46 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-59360a12-c8c1-4bb7-9d5b-e70d9c014d36-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-59360a12-c8c1-4bb7-9d5b-e70d9c014d36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-quobyte-59360a12-c8c1-4bb7-9d5b-e70d9c014d36" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-59360a12-c8c1-4bb7-9d5b-e70d9c014d36" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Deleting offline snapshot 59360a12-c8c1-4bb7-9d5b-e70d9c014d36 of volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] snapshot_file for this snap is: volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6353e2-9b46-4427-893e-78759eabaa00]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:46 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5466d6bf-f11d-4e93-91f2-92687a38a0e5" returned: 0 in 0.443s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "cinder-quobyte-5466d6bf-f11d-4e93-91f2-92687a38a0e5" released by "delete_volume" :: held 1.260s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:46 devstack sudo[93140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36
Nov 07 02:35:46 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.quota [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Created reservations ['1c2bd149-e5a9-4067-bd16-d1d0ff4277de', '7833cf52-995a-46be-b48b-72aee39c865b', '8256cc8c-48c9-455f-97ba-52ed267c9ea3', 'cdc29c14-8692-4d7b-adec-b86719c501f3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:46 devstack sudo[93143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:35:46 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:46 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36" returned: 0 in 0.520s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf459878-360b-4070-b2b1-ab717c8b6b57]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:47 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.347s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:47 devstack cinder-volume[87087]: DEBUG cinder.manager [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:35:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Deleted volume successfully.
Nov 07 02:35:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-22af8d70-5727-48e0-804d-1b3a3834b7e6 req-9ebbdeb2-959e-4a17-94fa-6e010f6dec9b tempest-VolumesSnapshotsTestJSON-641721044 None] Lock "cinder-5466d6bf-f11d-4e93-91f2-92687a38a0e5-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:47 devstack sudo[93148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:35:47 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:47 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.640s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:47 devstack sudo[93156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36
Nov 07 02:35:47 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-af25fb2c-64d5-49de-8bc2-55b43a837dfd req-555f7fcf-66b9-4722-a2f1-8788f9e2aeaf tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-af25fb2c-64d5-49de-8bc2-55b43a837dfd req-555f7fcf-66b9-4722-a2f1-8788f9e2aeaf tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-af25fb2c-64d5-49de-8bc2-55b43a837dfd req-555f7fcf-66b9-4722-a2f1-8788f9e2aeaf tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-af25fb2c-64d5-49de-8bc2-55b43a837dfd req-555f7fcf-66b9-4722-a2f1-8788f9e2aeaf tempest-ServerActionsTestOtherA-661875350 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-43827228-c6ce-478c-ba02-ce41698ff070', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b97a3d5-750f-4425-87a9-07936ee2e845', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:35:48 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36" returned: 0 in 0.575s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:48 devstack sudo[93183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36
Nov 07 02:35:48 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-af25fb2c-64d5-49de-8bc2-55b43a837dfd req-555f7fcf-66b9-4722-a2f1-8788f9e2aeaf tempest-ServerActionsTestOtherA-661875350 None] attachment_update completed successfully.
Nov 07 02:35:48 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.59360a12-c8c1-4bb7-9d5b-e70d9c014d36" returned: 0 in 0.423s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-59360a12-c8c1-4bb7-9d5b-e70d9c014d36" released by "_delete_snapshot" :: held 2.367s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" released by "delete_snapshot" :: held 2.401s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:48 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Created reservations ['50a4ce08-773b-442b-8382-15f339ee1639', '30b4921b-2298-4308-b922-101c5ea0fe03', '02dc8527-8e2b-4a5f-8f83-43d03e37a0eb', '1eb9d980-9e8e-4d08-9816-987de927e235'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Delete snapshot completed successfully.
Nov 07 02:35:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2cc31870-0e2c-4582-8715-90f3d4e1a9cc tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-59360a12-c8c1-4bb7-9d5b-e70d9c014d36-delete_snapshot" released by "delete_snapshot" :: held 2.630s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] Creating offline snapshot cc288521-5c7b-4678-a95e-bbd7849cd4a7 of volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:35:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5995a769-26e1-4f81-8065-6102fa7dbaaf]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:50 devstack sudo[93640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:35:50 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:50 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.465s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:50 devstack sudo[93645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7 1G
Nov 07 02:35:50 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:51 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7 1G" returned: 0 in 0.961s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:51 devstack sudo[93656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7
Nov 07 02:35:51 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:51 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7" returned: 0 in 0.443s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:51 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7 is being set with open permissions: ugo+rw
Nov 07 02:35:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:51 devstack sudo[93661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7
Nov 07 02:35:51 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:52 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a82c8b47-6410-4e8c-9aed-7a6a28417329 tempest-SnapshotsActionsTest-454374358 None] Create snapshot completed successfully
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:53 devstack sudo[93725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:35:53 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-cc288521-5c7b-4678-a95e-bbd7849cd4a7-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-cc288521-5c7b-4678-a95e-bbd7849cd4a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-quobyte-cc288521-5c7b-4678-a95e-bbd7849cd4a7" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-cc288521-5c7b-4678-a95e-bbd7849cd4a7" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Deleting offline snapshot cc288521-5c7b-4678-a95e-bbd7849cd4a7 of volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:35:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] snapshot_file for this snap is: volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:35:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5fb244-76f3-414e-87c1-0568fbc4e0b2]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:54 devstack sudo[93730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7
Nov 07 02:35:54 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:54 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 1.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:54 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:35:54 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:35:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:35:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:35:54 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7" returned: 0 in 0.943s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fef6d1e-c324-4731-94ab-9f564da9192f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:55 devstack sudo[93741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:35:55 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:55 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.747s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:55 devstack sudo[93746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7
Nov 07 02:35:55 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:56 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7" returned: 0 in 0.861s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:56 devstack sudo[93751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7
Nov 07 02:35:56 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:57 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.cc288521-5c7b-4678-a95e-bbd7849cd4a7" returned: 0 in 0.582s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-cc288521-5c7b-4678-a95e-bbd7849cd4a7" released by "_delete_snapshot" :: held 3.466s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" released by "delete_snapshot" :: held 3.563s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Created reservations ['7adbe011-1596-4e0a-8171-431c01fef0d5', '6e5f4896-fff5-4c06-843a-59947425be40', 'a1d526d4-d799-48ea-9422-42ac9107f177', '26fa1485-824b-4a9e-95de-c131ed69624b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Delete snapshot completed successfully.
Nov 07 02:35:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-47f754db-f9c2-4b76-954c-d62b2ea36be8 tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-cc288521-5c7b-4678-a95e-bbd7849cd4a7-delete_snapshot" released by "delete_snapshot" :: held 3.913s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=128,cinder:UPDATE=124,cinder:INSERT=34,cinder:DELETE=11 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=131,cinder:UPDATE=131,cinder:INSERT=40,cinder:DELETE=8 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] Creating offline snapshot b4c1a901-7430-482c-8955-3724ca63f5a3 of volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[675338a9-1230-41bd-8e79-00493d61e4d4]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-311067d7-82f4-422f-a0dc-4753bf112756 tempest-BackendsCapabilitiesAdminTestsJSON-1349138284 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7832832336426, 'free_capacity_gb': 1773.7832832336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87087) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4c982923-7b5d-49da-b492-166a655e40d9 tempest-BackendsCapabilitiesAdminTestsJSON-1349138284 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7832832336426, 'free_capacity_gb': 1773.7832832336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87087) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 07 02:35:59 devstack sudo[93777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:35:59 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:59 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.733s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:59 devstack sudo[93784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3 1G
Nov 07 02:35:59 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:00 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3 1G" returned: 0 in 0.901s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:00 devstack sudo[93792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3
Nov 07 02:36:00 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:01 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3" returned: 0 in 0.412s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:01 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3 is being set with open permissions: ugo+rw
Nov 07 02:36:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:01 devstack sudo[93798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3
Nov 07 02:36:01 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:01 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3" returned: 0 in 0.312s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-196d7f88-e366-470b-bf5d-9c0c2f2cb3a0 tempest-SnapshotsActionsTest-454374358 None] Create snapshot completed successfully
Nov 07 02:36:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-b4c1a901-7430-482c-8955-3724ca63f5a3-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-b4c1a901-7430-482c-8955-3724ca63f5a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Acquiring lock "cinder-quobyte-b4c1a901-7430-482c-8955-3724ca63f5a3" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-b4c1a901-7430-482c-8955-3724ca63f5a3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Deleting offline snapshot b4c1a901-7430-482c-8955-3724ca63f5a3 of volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:36:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] snapshot_file for this snap is: volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:36:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76f2e2e-dc77-4fcb-9963-8162a1ed0282]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:02 devstack sudo[93801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3
Nov 07 02:36:02 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:03 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3" returned: 0 in 0.498s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:36:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1be2aa-8432-4d4c-9043-704dbb9a1a31]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:03 devstack sudo[93807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:36:03 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:03 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.535s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:36:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:03 devstack sudo[93812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3
Nov 07 02:36:03 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:04 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3" returned: 0 in 0.475s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:04 devstack sudo[93817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3
Nov 07 02:36:04 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:04 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.b4c1a901-7430-482c-8955-3724ca63f5a3" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-b4c1a901-7430-482c-8955-3724ca63f5a3" released by "_delete_snapshot" :: held 2.000s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" released by "delete_snapshot" :: held 2.041s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:04 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Created reservations ['481f7015-cac5-4973-b54f-4dfbea25a998', 'f9b00097-9367-4c94-8fce-d14fd62354a4', '8428bfc5-04fd-45e8-9757-e8c3b417d4fa', '6609a95c-adc3-412e-9664-a72a7f1c5011'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Delete snapshot completed successfully.
Nov 07 02:36:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aea92674-eb4c-4934-843d-71e9dc45893d tempest-SnapshotsActionsTest-458794255 None] Lock "cinder-b4c1a901-7430-482c-8955-3724ca63f5a3-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "cinder-848ebc26-a7fd-4a22-9f6f-824cdf81668e-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Lock "cinder-848ebc26-a7fd-4a22-9f6f-824cdf81668e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "cinder-quobyte-848ebc26-a7fd-4a22-9f6f-824cdf81668e" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Lock "cinder-quobyte-848ebc26-a7fd-4a22-9f6f-824cdf81668e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Deleting offline snapshot 848ebc26-a7fd-4a22-9f6f-824cdf81668e of volume 49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:36:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] snapshot_file for this snap is: volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:36:06 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af0544-67c5-411e-8b7e-e9ce57d815e8]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:06 devstack sudo[93822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:36:06 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-974252a1-fe48-47aa-9638-9e5e705915a3 tempest-GroupSnapshotsV319Test-1669986082 None] Group tempest-GroupSnapshotsV319Test-Group-971418158: creating
Nov 07 02:36:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-974252a1-fe48-47aa-9638-9e5e705915a3 tempest-GroupSnapshotsV319Test-1669986082 None] Group tempest-GroupSnapshotsV319Test-Group-971418158: created successfully
Nov 07 02:36:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-974252a1-fe48-47aa-9638-9e5e705915a3 tempest-GroupSnapshotsV319Test-1669986082 None] Create group completed successfully.
Nov 07 02:36:07 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.489s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:36:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7793d6b3-cbf2-4f67-b0c0-8501f8703bd7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:07 devstack sudo[93828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431
Nov 07 02:36:07 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:07 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" returned: 0 in 0.430s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:07 devstack sudo[93833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:36:07 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:08 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.370s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:08 devstack sudo[93838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e
Nov 07 02:36:08 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:08 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431.848ebc26-a7fd-4a22-9f6f-824cdf81668e" returned: 0 in 0.297s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Lock "cinder-quobyte-848ebc26-a7fd-4a22-9f6f-824cdf81668e" released by "_delete_snapshot" :: held 1.720s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" released by "delete_snapshot" :: held 1.761s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:08 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Created reservations ['d4cbcaed-01ca-4bff-8fba-d802348fea88', 'd3698765-47c9-489d-92e3-d1cd7440a18f', 'c81e7ebf-0536-441f-a11f-856219349ad5', 'f399c1a7-7032-44a2-80e0-3ce3edb44660'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Delete snapshot completed successfully.
Nov 07 02:36:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c4ae6d39-7aa2-47f0-bdf3-81ace84c0528 tempest-SnapshotsActionsTest-454374358 None] Lock "cinder-848ebc26-a7fd-4a22-9f6f-824cdf81668e-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Flow 'volume_create_manager' (34068e25-fd5e-4478-b502-3d8ba1cd41bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d473248-bbeb-47ad-b0aa-f9ff0fe6e645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "cinder-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d473248-bbeb-47ad-b0aa-f9ff0fe6e645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919720053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f5f73ea3-2c97-4949-b330-e50dcb7fde5a,host='devstack@QuobyteHD#QuobyteHD',id=7b9f97b1-5d3e-4835-bcac-d5dba9d21010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8994e1556534fcabd0271938403f79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:09Z,use_quota=True,user_id='b72a1cbe1780469b9b3da273b311eecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d41f263-1eeb-4acc-ab45-b91999e8762e),volume_type_id=9d41f263-1eeb-4acc-ab45-b91999e8762e)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb66a4f-9f3d-4ae8-9e9e-da537aa0fa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb66a4f-9f3d-4ae8-9e9e-da537aa0fa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb822d99-2bb2-4770-8a57-4a7dcb3f55f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb822d99-2bb2-4770-8a57-4a7dcb3f55f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9f97b1-5d3e-4835-bcac-d5dba9d21010', 'volume_name': 'volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e8860e-a34c-4816-a0b1-ac58a2127143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e8860e-a34c-4816-a0b1-ac58a2127143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5e5a3b-ae25-4255-854a-ed9ef399ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Volume 7b9f97b1-5d3e-4835-bcac-d5dba9d21010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010', 'volume_size': 1}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f5f73ea3-2c97-4949-b330-e50dcb7fde5a,created_at=2026-11-07T01:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919720053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f5f73ea3-2c97-4949-b330-e50dcb7fde5a,host='devstack@QuobyteHD#QuobyteHD',id=7b9f97b1-5d3e-4835-bcac-d5dba9d21010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8994e1556534fcabd0271938403f79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:09Z,use_quota=True,user_id='b72a1cbe1780469b9b3da273b311eecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d41f263-1eeb-4acc-ab45-b91999e8762e),volume_type_id=9d41f263-1eeb-4acc-ab45-b91999e8762e)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Creating volume 7b9f97b1-5d3e-4835-bcac-d5dba9d21010 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:36:09 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Lock "cinder-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:09 devstack sudo[93866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 1073741824
Nov 07 02:36:09 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dee551f-0fdf-4b32-8664-68c6f30ff5e1]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:09 devstack sudo[93869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431
Nov 07 02:36:09 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:09 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 1073741824" returned: 0 in 0.615s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:09 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" returned: 0 in 0.492s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:09 devstack sudo[93879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431
Nov 07 02:36:09 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:09 devstack sudo[93880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010
Nov 07 02:36:09 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:10 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" returned: 0 in 0.339s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Lock "cinder-quobyte-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431" released by "delete_volume" :: held 0.962s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:10 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010" returned: 0 in 0.377s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5e5a3b-ae25-4255-854a-ed9ef399ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1928935-3169-4481-bf99-5aea8ac3f26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:10 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Volume volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 (7b9f97b1-5d3e-4835-bcac-d5dba9d21010): created successfully
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1928935-3169-4481-bf99-5aea8ac3f26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Flow 'volume_create_manager' (34068e25-fd5e-4478-b502-3d8ba1cd41bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0ec70c37-2a79-4bfa-b563-908df6efbda9 tempest-GroupSnapshotsV319Test-1669986082 None] Created volume successfully.
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Created reservations ['c66bb3f5-1b52-43b9-9100-d4c575b1ec48', '684690f9-7f6c-4466-ad1a-a08c12f0c0d2', '599f6c5b-27a0-435e-9090-1e12c9ac8b42', '15a12ff1-860c-4a35-93ae-c272568445e1'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:10 devstack sudo[93885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:36:10 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:10 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.300s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Deleted volume successfully.
Nov 07 02:36:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7a3ff057-1cff-4f81-86df-cc3c85742ff0 tempest-SnapshotsActionsTest-454374358 None] Lock "cinder-49b8cfc1-c8ca-4237-a0cd-2ca89bd0d431-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Acquiring lock "cinder-70174791-b3db-497f-a2ec-15f5c2b1393d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Lock "cinder-70174791-b3db-497f-a2ec-15f5c2b1393d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Acquiring lock "cinder-quobyte-70174791-b3db-497f-a2ec-15f5c2b1393d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Lock "cinder-quobyte-70174791-b3db-497f-a2ec-15f5c2b1393d" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e516d0e3-e3d9-4433-96e0-298848eb563a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] GroupSnapshot f3d9dea8-44ce-45a6-ba82-7722aa170db3: creating.
Nov 07 02:36:11 devstack sudo[93897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d
Nov 07 02:36:11 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] Group snapshot f3d9dea8-44ce-45a6-ba82-7722aa170db3: creating. {{(pid=87087) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] Creating offline snapshot 7bc7bae6-0908-495b-b1be-54842e22c97c of volume 7b9f97b1-5d3e-4835-bcac-d5dba9d21010 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7b858f-8454-4f1b-8b9b-8e8af324edef]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:12 devstack sudo[93899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010
Nov 07 02:36:12 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:12 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d" returned: 0 in 0.396s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:12 devstack sudo[93905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d
Nov 07 02:36:12 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:12 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010" returned: 0 in 0.413s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:12 devstack sudo[93910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c 1G
Nov 07 02:36:12 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:12 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-70174791-b3db-497f-a2ec-15f5c2b1393d" returned: 0 in 0.279s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Lock "cinder-quobyte-70174791-b3db-497f-a2ec-15f5c2b1393d" released by "delete_volume" :: held 0.741s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Created reservations ['977438c7-2fde-4e4e-89b7-d1c1d28b9e98', 'e00be612-85db-4120-a28c-a07f35b6a978', '86cd177c-2ffc-4378-a670-8eadacbd5873', 'b597a97d-cd1f-4925-80d7-44a34795a1fd'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:12 devstack sudo[93913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:36:12 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:12 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Deleted volume successfully.
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-07531e91-a44e-440f-b21e-b8f81178c63f tempest-VolumesNegativeTest-1035882956 None] Lock "cinder-70174791-b3db-497f-a2ec-15f5c2b1393d-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:12 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c 1G" returned: 0 in 0.554s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:12 devstack sudo[93919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c
Nov 07 02:36:12 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:13 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c" returned: 0 in 0.364s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:13 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:36:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:13 devstack sudo[93924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c
Nov 07 02:36:13 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:13 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c" returned: 0 in 0.302s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:13 devstack sudo[93927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.info
Nov 07 02:36:13 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:13 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.info" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:13 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:36:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:13 devstack sudo[93930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.info
Nov 07 02:36:13 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:14 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.info" returned: 0 in 0.296s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-50feedff-5329-4d76-85e2-2824a62fd992 tempest-GroupSnapshotsV319Test-1669986082 None] group_snapshot f3d9dea8-44ce-45a6-ba82-7722aa170db3: created successfully
Nov 07 02:36:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] group_snapshot f3d9dea8-44ce-45a6-ba82-7722aa170db3: deleting
Nov 07 02:36:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] group_snapshot f3d9dea8-44ce-45a6-ba82-7722aa170db3: deleting {{(pid=87087) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 07 02:36:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Acquiring lock "cinder-quobyte-7b9f97b1-5d3e-4835-bcac-d5dba9d21010" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Lock "cinder-quobyte-7b9f97b1-5d3e-4835-bcac-d5dba9d21010" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Acquiring lock "cinder-quobyte-7bc7bae6-0908-495b-b1be-54842e22c97c" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Lock "cinder-quobyte-7bc7bae6-0908-495b-b1be-54842e22c97c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Deleting offline snapshot 7bc7bae6-0908-495b-b1be-54842e22c97c of volume 7b9f97b1-5d3e-4835-bcac-d5dba9d21010 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:36:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] snapshot_file for this snap is: volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:36:16 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d2ae0a-7b57-48f0-a300-e51e4db071b5]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:16 devstack sudo[93933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c
Nov 07 02:36:16 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:16 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c" returned: 0 in 0.474s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:36:16 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e639c4-bf44-461c-90bb-83e4950a6aae]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:16 devstack sudo[93938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010
Nov 07 02:36:16 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:16 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:16 devstack sudo[93943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c
Nov 07 02:36:16 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:17 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c" returned: 0 in 0.405s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:17 devstack sudo[93949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c
Nov 07 02:36:17 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:17 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010.7bc7bae6-0908-495b-b1be-54842e22c97c" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Lock "cinder-quobyte-7bc7bae6-0908-495b-b1be-54842e22c97c" released by "_delete_snapshot" :: held 1.825s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Lock "cinder-quobyte-7b9f97b1-5d3e-4835-bcac-d5dba9d21010" released by "delete_snapshot" :: held 1.860s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:17 devstack cinder-volume[87087]: WARNING cinder.quota [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-347551403 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-347551403, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:36:17 devstack cinder-volume[87087]: WARNING cinder.quota [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-347551403 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-347551403, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:36:17 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] Created reservations ['b6a4c1e6-546f-498a-a30e-16d54a2727b7', '6e06b192-3bc2-4cb1-b468-b7dd17b46c18', 'f88441ad-b994-4cf2-86e5-5089c0a670a9', '320e74a5-f5d0-4f39-b4b5-0b1843706cc0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4afd478a-5632-4fa4-9fe7-f5343395d16e tempest-GroupSnapshotsV319Test-1669986082 None] group_snapshot f3d9dea8-44ce-45a6-ba82-7722aa170db3: deleted successfully
Nov 07 02:36:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Acquiring lock "cinder-quobyte-7b9f97b1-5d3e-4835-bcac-d5dba9d21010" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Lock "cinder-quobyte-7b9f97b1-5d3e-4835-bcac-d5dba9d21010" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef92a02-8004-4eec-819c-9c35f8644d06]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:18 devstack sudo[93952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010
Nov 07 02:36:18 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:19 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010" returned: 0 in 0.490s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:19 devstack sudo[93958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010
Nov 07 02:36:19 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:19 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7b9f97b1-5d3e-4835-bcac-d5dba9d21010" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Lock "cinder-quobyte-7b9f97b1-5d3e-4835-bcac-d5dba9d21010" released by "delete_volume" :: held 0.935s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Created reservations ['9f9c6f55-a932-4242-81b4-24df4b54aadf'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:19 devstack cinder-volume[87087]: WARNING cinder.quota [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-347551403 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-347551403, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Created reservations ['e2250469-a990-49d1-83dc-92beb0d2de1d', 'c998b933-c5c9-4e8d-9e00-3e08c5ccde9b', 'bb6e45e1-0d91-4e19-8862-8c5d1e2a5acc', '501d16ac-133a-46a8-8e3c-2d09a5aa236e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:19 devstack sudo[93961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:36:19 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:20 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.328s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:20 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-69f4b961-ec2f-426c-be2f-189c57efb356 tempest-GroupSnapshotsV319Test-1669986082 None] Delete group completed successfully.
Nov 07 02:36:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-e1faca55-d605-4633-9362-24e022bc3801 tempest-ServerActionsTestOtherA-661875350 None] Terminate volume connection completed successfully.
Nov 07 02:36:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-e1faca55-d605-4633-9362-24e022bc3801 tempest-ServerActionsTestOtherA-661875350 None] Deleting attachment 5b97a3d5-750f-4425-87a9-07936ee2e845. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "cinder-43827228-c6ce-478c-ba02-ce41698ff070-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Lock "cinder-43827228-c6ce-478c-ba02-ce41698ff070-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "cinder-quobyte-43827228-c6ce-478c-ba02-ce41698ff070" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Lock "cinder-quobyte-43827228-c6ce-478c-ba02-ce41698ff070" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd34e19-12a9-4739-b093-f4002a4a6e94]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Flow 'volume_create_manager' (465ee146-208e-4c68-ae00-cb53716fafff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08816fa4-76f9-4768-93a5-797ad27ee8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:27 devstack sudo[94000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070
Nov 07 02:36:27 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08816fa4-76f9-4768-93a5-797ad27ee8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-960438745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261e9cde-1631-439f-b6ab-8f764e5d4cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf8b69d228a4b00bf765dae65ae8ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:27Z,use_quota=True,user_id='7ff19a9851db43c09eef4baefaf387c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572a681d-7285-4490-8ad2-77d555a13b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572a681d-7285-4490-8ad2-77d555a13b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2362b72-b223-4535-81df-4d81a9d48883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2362b72-b223-4535-81df-4d81a9d48883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261e9cde-1631-439f-b6ab-8f764e5d4cba', 'volume_name': 'volume-261e9cde-1631-439f-b6ab-8f764e5d4cba', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f161aef-9422-48c8-abf2-772bfa556a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f161aef-9422-48c8-abf2-772bfa556a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255a5f82-ce5f-47b6-8920-9fb2be543e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Volume 261e9cde-1631-439f-b6ab-8f764e5d4cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261e9cde-1631-439f-b6ab-8f764e5d4cba', 'volume_size': 1}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-960438745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261e9cde-1631-439f-b6ab-8f764e5d4cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf8b69d228a4b00bf765dae65ae8ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:27Z,use_quota=True,user_id='7ff19a9851db43c09eef4baefaf387c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Creating volume 261e9cde-1631-439f-b6ab-8f764e5d4cba {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:36:27 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:36:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:27 devstack sudo[94002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba 1073741824
Nov 07 02:36:27 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:28 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070" returned: 0 in 0.669s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "cinder-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Lock "cinder-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:28 devstack sudo[94010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070
Nov 07 02:36:28 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "cinder-quobyte-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Lock "cinder-quobyte-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c09aa92-6e12-46d6-9c43-68801590f69d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:28 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:28 devstack sudo[94012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba 1073741824" returned: 0 in 0.804s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:28 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:28 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-43827228-c6ce-478c-ba02-ce41698ff070" returned: 0 in 0.460s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:28 devstack sudo[94018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba
Nov 07 02:36:28 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Lock "cinder-quobyte-43827228-c6ce-478c-ba02-ce41698ff070" released by "delete_volume" :: held 1.213s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.quota [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Created reservations ['0d674fba-1b59-4986-8ab6-ead1e340a225', '50d4eb45-d507-4d00-afc3-d2babb1c4fc6', '3599ea76-2976-4d6d-8b8b-62e93457afe5', '75347879-d619-4ad0-a201-8d9a05b29565'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:28 devstack sudo[94023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:36:28 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:28 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc" returned: 0 in 0.592s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:28 devstack sudo[94025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc
Nov 07 02:36:28 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:28 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba" returned: 0 in 0.428s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255a5f82-ce5f-47b6-8920-9fb2be543e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261e9cde-1631-439f-b6ab-8f764e5d4cba', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930a57e6-927c-46d9-850a-85d2a0550dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Volume volume-261e9cde-1631-439f-b6ab-8f764e5d4cba (261e9cde-1631-439f-b6ab-8f764e5d4cba): created successfully
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930a57e6-927c-46d9-850a-85d2a0550dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Flow 'volume_create_manager' (465ee146-208e-4c68-ae00-cb53716fafff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a36c3033-e075-4ff4-a6c3-fc1f853e9c86 tempest-VolumeQuotasNegativeTestJSON-925616352 None] Created volume successfully.
Nov 07 02:36:29 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.400s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG cinder.manager [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Deleted volume successfully.
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-f33ba699-7ef3-4895-b007-e022d0fd118f req-6fd5c5b1-c97a-4272-8bd7-54b43e4b4591 tempest-ServerActionsTestOtherA-661875350 None] Lock "cinder-43827228-c6ce-478c-ba02-ce41698ff070-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:29 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc" returned: 0 in 0.368s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Lock "cinder-quobyte-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc" released by "delete_volume" :: held 1.031s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Created reservations ['3d870aa2-72b8-4d17-84cc-511c6ceb171f', '5970e801-ead7-4c15-9c6a-c294b0c03b7a', '8ffd3154-c3c7-4db9-824c-ab45bb2b8919', '4502b51b-077f-4c1e-b782-85dd3adb67d8'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:29 devstack sudo[94064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:36:29 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:30 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.484s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:30 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Deleted volume successfully.
Nov 07 02:36:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f29cce26-9aab-4567-91a0-2b4a79f5936d tempest-ServerActionsTestOtherA-661875350 None] Lock "cinder-a854f8d3-17d9-4b0d-bc18-31e9a04ff0dc-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Acquiring lock "cinder-261e9cde-1631-439f-b6ab-8f764e5d4cba-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Lock "cinder-261e9cde-1631-439f-b6ab-8f764e5d4cba-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Acquiring lock "cinder-quobyte-261e9cde-1631-439f-b6ab-8f764e5d4cba" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Lock "cinder-quobyte-261e9cde-1631-439f-b6ab-8f764e5d4cba" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd5f677-cba7-4df4-a09a-d3497d6f050d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:32 devstack sudo[94092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba
Nov 07 02:36:32 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:32 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba" returned: 0 in 0.557s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:32 devstack sudo[94098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba
Nov 07 02:36:32 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:32 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-261e9cde-1631-439f-b6ab-8f764e5d4cba" returned: 0 in 0.421s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Lock "cinder-quobyte-261e9cde-1631-439f-b6ab-8f764e5d4cba" released by "delete_volume" :: held 1.058s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:33 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Created reservations ['d7b18502-f65d-40bb-b742-0e4df394c523', 'c7f6b9c2-c469-436e-a558-e0fe67c7406e', '5497245a-299a-48d6-860d-a8eadbdd990e', '0594261f-c274-4507-9f61-4bd431d955bd'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:33 devstack sudo[94102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:36:33 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:33 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.315s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:33 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Deleted volume successfully.
Nov 07 02:36:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88478734-c2c6-4191-b099-ec7455b015cf tempest-VolumeQuotasNegativeTestJSON-925616352 None] Lock "cinder-261e9cde-1631-439f-b6ab-8f764e5d4cba-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:43 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:36:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Flow 'volume_create_manager' (ec725501-be6e-4767-8066-0b43363abec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef54c3ac-2b9e-4f8e-80bc-978403ad7c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef54c3ac-2b9e-4f8e-80bc-978403ad7c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1136740975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c0f497-fdd1-4b2d-913c-d36b230cc885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a0d259ca0848099bb5c3f157634161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:44Z,use_quota=True,user_id='70739c76616d4d05ab04880bc508c6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb7f85b-a5b2-4168-af02-27b265179ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb7f85b-a5b2-4168-af02-27b265179ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e5a943-9a8f-405f-89c5-36f5e1c533ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e5a943-9a8f-405f-89c5-36f5e1c533ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c0f497-fdd1-4b2d-913c-d36b230cc885', 'volume_name': 'volume-74c0f497-fdd1-4b2d-913c-d36b230cc885', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e857a4-1c32-4b27-a072-46f92bebe65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e857a4-1c32-4b27-a072-46f92bebe65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee5c24e-15a2-420c-ad1c-1739c906dd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Volume 74c0f497-fdd1-4b2d-913c-d36b230cc885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c0f497-fdd1-4b2d-913c-d36b230cc885', 'volume_size': 1}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1136740975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c0f497-fdd1-4b2d-913c-d36b230cc885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a0d259ca0848099bb5c3f157634161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:44Z,use_quota=True,user_id='70739c76616d4d05ab04880bc508c6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Creating volume 74c0f497-fdd1-4b2d-913c-d36b230cc885 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:36:44 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:44 devstack sudo[94111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885 1073741824
Nov 07 02:36:44 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Flow 'volume_create_manager' (da98c41d-c4ea-4529-b344-2786b19ce322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bace910-71a7-43bd-bc5e-15f5d88d8127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bace910-71a7-43bd-bc5e-15f5d88d8127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1775847178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fbff0c-6675-4739-943c-33e57d7207d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a0d259ca0848099bb5c3f157634161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:45Z,use_quota=True,user_id='70739c76616d4d05ab04880bc508c6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d8c85b-5d90-40b6-bcf0-00f22c40c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d8c85b-5d90-40b6-bcf0-00f22c40c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a254af80-cecb-4f1f-a820-3aa8b8c6c205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a254af80-cecb-4f1f-a820-3aa8b8c6c205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1fbff0c-6675-4739-943c-33e57d7207d9', 'volume_name': 'volume-f1fbff0c-6675-4739-943c-33e57d7207d9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0d0d2b-e6b1-4ab7-a3d9-5ccf6394e566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0d0d2b-e6b1-4ab7-a3d9-5ccf6394e566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9390ed-39f7-4636-ae2e-b78b82dfe681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Volume f1fbff0c-6675-4739-943c-33e57d7207d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1fbff0c-6675-4739-943c-33e57d7207d9', 'volume_size': 1}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885 1073741824" returned: 0 in 0.712s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:44 devstack sudo[94117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885
Nov 07 02:36:44 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:45 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885" returned: 0 in 0.332s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.389s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1775847178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fbff0c-6675-4739-943c-33e57d7207d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a0d259ca0848099bb5c3f157634161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:45Z,use_quota=True,user_id='70739c76616d4d05ab04880bc508c6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Creating volume f1fbff0c-6675-4739-943c-33e57d7207d9 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:36:45 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee5c24e-15a2-420c-ad1c-1739c906dd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c0f497-fdd1-4b2d-913c-d36b230cc885', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9105669b-f8d9-45f4-abee-ebbd110814fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:45 devstack sudo[94120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9 1073741824
Nov 07 02:36:45 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:45 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Volume volume-74c0f497-fdd1-4b2d-913c-d36b230cc885 (74c0f497-fdd1-4b2d-913c-d36b230cc885): created successfully
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9105669b-f8d9-45f4-abee-ebbd110814fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Flow 'volume_create_manager' (ec725501-be6e-4767-8066-0b43363abec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-464048a2-546c-4296-93b4-b530796bd4a8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Created volume successfully.
Nov 07 02:36:45 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9 1073741824" returned: 0 in 0.639s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:45 devstack sudo[94132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9
Nov 07 02:36:45 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:46 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9" returned: 0 in 0.354s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:36:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9390ed-39f7-4636-ae2e-b78b82dfe681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fbff0c-6675-4739-943c-33e57d7207d9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2428da75-9c12-4053-be81-91ef4233341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:46 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Volume volume-f1fbff0c-6675-4739-943c-33e57d7207d9 (f1fbff0c-6675-4739-943c-33e57d7207d9): created successfully
Nov 07 02:36:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2428da75-9c12-4053-be81-91ef4233341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Flow 'volume_create_manager' (da98c41d-c4ea-4529-b344-2786b19ce322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a6585230-015c-4f5e-85be-9036e22ee803 tempest-TestServerVolumeAttachmentScenario-372114823 None] Created volume successfully.
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:53 devstack sudo[94156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:36:53 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:53 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.361s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:36:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:36:56 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=69,cinder:UPDATE=87,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:36:56 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=69,cinder:DELETE=6,cinder:INSERT=22,cinder:UPDATE=81 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Flow 'volume_create_manager' (ac690117-8a05-4e48-a119-92d43464ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de39d0b1-cf28-42b2-a2ab-dd0e787e0b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de39d0b1-cf28-42b2-a2ab-dd0e787e0b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-435254018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9f0524-289f-42ef-a0ef-a56388fa285b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1de5736313481d99625b228f71d7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:00Z,use_quota=True,user_id='3c793c300714407a82ff84959fc8ac41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1fb46fb-0412-46b9-a019-860ede56287a),volume_type_id=a1fb46fb-0412-46b9-a019-860ede56287a)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7765b5e7-1ac9-47a6-ba68-e5db3369ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7765b5e7-1ac9-47a6-ba68-e5db3369ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7435844-8d1d-497c-b5ca-685c38ec7376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7435844-8d1d-497c-b5ca-685c38ec7376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f9f0524-289f-42ef-a0ef-a56388fa285b', 'volume_name': 'volume-2f9f0524-289f-42ef-a0ef-a56388fa285b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80269b4-577d-4467-b639-d4495379bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80269b4-577d-4467-b639-d4495379bd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29ed397-0481-46e1-9e63-a3e8b996d881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Volume 2f9f0524-289f-42ef-a0ef-a56388fa285b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f9f0524-289f-42ef-a0ef-a56388fa285b', 'volume_size': 1}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-435254018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9f0524-289f-42ef-a0ef-a56388fa285b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1de5736313481d99625b228f71d7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:00Z,use_quota=True,user_id='3c793c300714407a82ff84959fc8ac41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1fb46fb-0412-46b9-a019-860ede56287a),volume_type_id=a1fb46fb-0412-46b9-a019-860ede56287a)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Creating volume 2f9f0524-289f-42ef-a0ef-a56388fa285b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:36:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:36:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:59 devstack sudo[94173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b 1073741824
Nov 07 02:36:59 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:00 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b 1073741824" returned: 0 in 0.799s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:00 devstack sudo[94229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b
Nov 07 02:37:00 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:01 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b" returned: 0 in 0.749s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29ed397-0481-46e1-9e63-a3e8b996d881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f9f0524-289f-42ef-a0ef-a56388fa285b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1144ed61-8410-4358-b201-cf836e841d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:01 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Volume volume-2f9f0524-289f-42ef-a0ef-a56388fa285b (2f9f0524-289f-42ef-a0ef-a56388fa285b): created successfully
Nov 07 02:37:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1144ed61-8410-4358-b201-cf836e841d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Flow 'volume_create_manager' (ac690117-8a05-4e48-a119-92d43464ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3aa5beaf-ccfd-47c3-a8a8-b6fe15b5044b tempest-VolumeTypesAccessTest-1214198137 None] Created volume successfully.
Nov 07 02:37:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Acquiring lock "cinder-2f9f0524-289f-42ef-a0ef-a56388fa285b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Lock "cinder-2f9f0524-289f-42ef-a0ef-a56388fa285b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Acquiring lock "cinder-quobyte-2f9f0524-289f-42ef-a0ef-a56388fa285b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Lock "cinder-quobyte-2f9f0524-289f-42ef-a0ef-a56388fa285b" acquired by "delete_volume" :: waited 0.050s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3c89e2-52e4-418f-96a8-c23525bdf3f7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:02 devstack sudo[94244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b
Nov 07 02:37:02 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:02 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b" returned: 0 in 0.741s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:03 devstack sudo[94252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b
Nov 07 02:37:03 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:03 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2f9f0524-289f-42ef-a0ef-a56388fa285b" returned: 0 in 0.500s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Lock "cinder-quobyte-2f9f0524-289f-42ef-a0ef-a56388fa285b" released by "delete_volume" :: held 1.376s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:03 devstack cinder-volume[87087]: WARNING cinder.quota [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-446619445 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-446619445, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:37:03 devstack cinder-volume[87087]: WARNING cinder.quota [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-446619445 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-446619445, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:37:03 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Created reservations ['b7a69141-a1f6-435f-bfdf-c6efa5c06906', '8895943f-d5c3-41da-8ba7-b4c77192f6b3', 'a03379db-d1bf-4647-828f-477fb49d905e', '318a760c-260e-4daf-a674-48323a0b7346'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:03 devstack sudo[94255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:37:03 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:04 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.570s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:04 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Deleted volume successfully.
Nov 07 02:37:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ea9dfdb7-0e5a-42d9-ac81-2880cfdb800a tempest-VolumeTypesAccessTest-1214198137 None] Lock "cinder-2f9f0524-289f-42ef-a0ef-a56388fa285b-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Flow 'volume_create_manager' (d028794f-a37a-4184-83b9-3badb3c2cc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019f9d2d-d6f8-4fc8-94da-59a5e83d2dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019f9d2d-d6f8-4fc8-94da-59a5e83d2dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-212456531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cda7a6-8f9d-41d2-81be-880c50d26f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ba8ab3e4194d678adee2825672b65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:05Z,use_quota=True,user_id='15d7f50317e34e71a2a1805263de7477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa16510-53ce-4dff-a8cc-16f86df2e0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa16510-53ce-4dff-a8cc-16f86df2e0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b08d6a1-d907-4506-b522-4f9bc9e94c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b08d6a1-d907-4506-b522-4f9bc9e94c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96cda7a6-8f9d-41d2-81be-880c50d26f2b', 'volume_name': 'volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2e4d98-41a7-455c-9005-04a907852db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2e4d98-41a7-455c-9005-04a907852db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dbd5402-bd09-4623-a1c7-f8374737d72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:05 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Volume 96cda7a6-8f9d-41d2-81be-880c50d26f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b', 'volume_size': 1}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-212456531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cda7a6-8f9d-41d2-81be-880c50d26f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ba8ab3e4194d678adee2825672b65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:05Z,use_quota=True,user_id='15d7f50317e34e71a2a1805263de7477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Creating volume 96cda7a6-8f9d-41d2-81be-880c50d26f2b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:05 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:37:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:05 devstack sudo[94274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b 1073741824
Nov 07 02:37:05 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:06 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b 1073741824" returned: 0 in 0.941s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:06 devstack sudo[94284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b
Nov 07 02:37:06 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:07 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b" returned: 0 in 0.518s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dbd5402-bd09-4623-a1c7-f8374737d72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fe59ec-f94e-49d8-91cf-48faa9dcf3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Volume volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b (96cda7a6-8f9d-41d2-81be-880c50d26f2b): created successfully
Nov 07 02:37:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fe59ec-f94e-49d8-91cf-48faa9dcf3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Flow 'volume_create_manager' (d028794f-a37a-4184-83b9-3badb3c2cc6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9525e633-9406-486f-b220-9af198adda24 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Created volume successfully.
Nov 07 02:37:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Creating offline snapshot 994c5d37-1de7-4e6b-b512-07b4628f97d7 of volume 96cda7a6-8f9d-41d2-81be-880c50d26f2b {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:37:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb1cde8-b6dc-4cfe-b680-a701dd2d3e60]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:08 devstack sudo[94305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b
Nov 07 02:37:08 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:08 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b" returned: 0 in 0.624s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:08 devstack sudo[94311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7 1G
Nov 07 02:37:08 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:09 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7 1G" returned: 0 in 0.681s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:09 devstack sudo[94317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7
Nov 07 02:37:09 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:09 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7" returned: 0 in 0.494s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:09 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7 is being set with open permissions: ugo+rw
Nov 07 02:37:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:09 devstack sudo[94324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7
Nov 07 02:37:09 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:10 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7" returned: 0 in 0.568s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:10 devstack sudo[94327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.info
Nov 07 02:37:10 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:10 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.info" returned: 0 in 0.311s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:10 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.info is being set with open permissions: ugo+rw
Nov 07 02:37:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:10 devstack sudo[94330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.info
Nov 07 02:37:10 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:11 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.info" returned: 0 in 0.328s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.166s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-61a96cc0-a146-4048-b69b-a6b31c6ebdbe tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Create snapshot completed successfully
Nov 07 02:37:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Acquiring lock "cinder-994c5d37-1de7-4e6b-b512-07b4628f97d7-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "cinder-994c5d37-1de7-4e6b-b512-07b4628f97d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Acquiring lock "cinder-quobyte-96cda7a6-8f9d-41d2-81be-880c50d26f2b" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "cinder-quobyte-96cda7a6-8f9d-41d2-81be-880c50d26f2b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Acquiring lock "cinder-quobyte-994c5d37-1de7-4e6b-b512-07b4628f97d7" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "cinder-quobyte-994c5d37-1de7-4e6b-b512-07b4628f97d7" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Deleting offline snapshot 994c5d37-1de7-4e6b-b512-07b4628f97d7 of volume 96cda7a6-8f9d-41d2-81be-880c50d26f2b {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:37:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] snapshot_file for this snap is: volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:37:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddee2330-fd89-4a21-9e46-e6fb35c5cf1d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:14 devstack sudo[94402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7
Nov 07 02:37:14 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:15 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7" returned: 0 in 1.382s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:37:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[803b34fe-42c3-46b7-b331-d2611eb92ea1]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:15 devstack sudo[94463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b
Nov 07 02:37:15 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:16 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b" returned: 0 in 0.912s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:16 devstack sudo[94470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7
Nov 07 02:37:16 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:16 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7" returned: 0 in 0.787s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:16 devstack sudo[94478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7
Nov 07 02:37:16 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:17 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b.994c5d37-1de7-4e6b-b512-07b4628f97d7" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "cinder-quobyte-994c5d37-1de7-4e6b-b512-07b4628f97d7" released by "_delete_snapshot" :: held 3.813s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "cinder-quobyte-96cda7a6-8f9d-41d2-81be-880c50d26f2b" released by "delete_snapshot" :: held 3.867s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:17 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Created reservations ['623675f5-f86a-4454-b9cd-8b979373a9eb', 'dc1e921a-eefd-4393-b8f1-0d5e33102eb9', 'a6fce4af-854e-4117-93ef-e553f0c8e6dc', 'a3f107f9-201c-4fbc-9824-dcf7052fe0b2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Delete snapshot completed successfully.
Nov 07 02:37:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0909766c-68c8-49a4-9859-21342bf949b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "cinder-994c5d37-1de7-4e6b-b512-07b4628f97d7-delete_snapshot" released by "delete_snapshot" :: held 4.190s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Acquiring lock "cinder-96cda7a6-8f9d-41d2-81be-880c50d26f2b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "cinder-96cda7a6-8f9d-41d2-81be-880c50d26f2b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Acquiring lock "cinder-quobyte-96cda7a6-8f9d-41d2-81be-880c50d26f2b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "cinder-quobyte-96cda7a6-8f9d-41d2-81be-880c50d26f2b" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3a718e-374c-4b81-9383-2be289a3188e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:18 devstack sudo[94482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b
Nov 07 02:37:18 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:18 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b" returned: 0 in 0.635s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:18 devstack sudo[94487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b
Nov 07 02:37:18 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:19 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96cda7a6-8f9d-41d2-81be-880c50d26f2b" returned: 0 in 0.478s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "cinder-quobyte-96cda7a6-8f9d-41d2-81be-880c50d26f2b" released by "delete_volume" :: held 1.286s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:19 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Created reservations ['81adb53b-8229-44e2-91ce-cdd0a2eafef3', '82cb14c0-1c40-439c-809c-8cb17e951879', 'fd7f9a09-7ffc-4a52-8e56-775cd2ec516a', '40331d7f-caa4-45db-9ef2-9ae58f7dbce5'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:19 devstack sudo[94491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:37:19 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:20 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.352s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:20 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Deleted volume successfully.
Nov 07 02:37:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-57abedb4-bb09-4610-829c-9fa89934943b tempest-VolumeSnapshotQuotasNegativeTestJSON-972336407 None] Lock "cinder-96cda7a6-8f9d-41d2-81be-880c50d26f2b-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Flow 'volume_create_manager' (d1aa5e82-477f-4e9f-b00e-4f1614a9d02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a514c5bb-6b97-4c5f-9dda-6d5a2c60b3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a514c5bb-6b97-4c5f-9dda-6d5a2c60b3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-781396566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfd3d98-6306-4524-b0fd-457a3b9921b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c757e2a84b9441fa89ebb41a0a39c649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:26Z,use_quota=True,user_id='cc8c6f12a0354cf9bbdb94d84a1fdc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98105b3b-5120-4e76-b482-075e8c8cba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98105b3b-5120-4e76-b482-075e8c8cba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8995b7b1-d0c7-4644-8f94-34a959fb8ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8995b7b1-d0c7-4644-8f94-34a959fb8ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfd3d98-6306-4524-b0fd-457a3b9921b9', 'volume_name': 'volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7abc88-ec2d-4045-a0e6-4d70f4889532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7abc88-ec2d-4045-a0e6-4d70f4889532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d1e03d-afb5-4292-878b-b22f4abb023d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Volume 2cfd3d98-6306-4524-b0fd-457a3b9921b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9', 'volume_size': 1}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-781396566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfd3d98-6306-4524-b0fd-457a3b9921b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c757e2a84b9441fa89ebb41a0a39c649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:26Z,use_quota=True,user_id='cc8c6f12a0354cf9bbdb94d84a1fdc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Creating volume 2cfd3d98-6306-4524-b0fd-457a3b9921b9 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:26 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:37:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:26 devstack sudo[94531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9 1073741824
Nov 07 02:37:26 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:27 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9 1073741824" returned: 0 in 1.048s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:27 devstack sudo[94537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9
Nov 07 02:37:27 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:27 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9" returned: 0 in 0.484s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d1e03d-afb5-4292-878b-b22f4abb023d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4579cc5-167f-4bfc-8c0a-f2c74e2a321d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Volume volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9 (2cfd3d98-6306-4524-b0fd-457a3b9921b9): created successfully
Nov 07 02:37:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4579cc5-167f-4bfc-8c0a-f2c74e2a321d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Flow 'volume_create_manager' (d1aa5e82-477f-4e9f-b00e-4f1614a9d02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7de2a1da-3146-4120-87bd-92613ea71def tempest-ServerRescueNegativeTestJSON-528331802 None] Created volume successfully.
Nov 07 02:37:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-7354ca5b-1a72-411e-9afc-5bc0ee73cedd req-fa1405a8-a4ef-4322-a7e7-74295feff093 tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-7354ca5b-1a72-411e-9afc-5bc0ee73cedd req-fa1405a8-a4ef-4322-a7e7-74295feff093 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-7354ca5b-1a72-411e-9afc-5bc0ee73cedd req-fa1405a8-a4ef-4322-a7e7-74295feff093 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-7354ca5b-1a72-411e-9afc-5bc0ee73cedd req-fa1405a8-a4ef-4322-a7e7-74295feff093 tempest-TestServerVolumeAttachmentScenario-372114823 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-74c0f497-fdd1-4b2d-913c-d36b230cc885', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '955a4d5f-d05a-4fc8-997b-4bc102ab37fc', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:37:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-7354ca5b-1a72-411e-9afc-5bc0ee73cedd req-fa1405a8-a4ef-4322-a7e7-74295feff093 tempest-TestServerVolumeAttachmentScenario-372114823 None] attachment_update completed successfully.
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Flow 'volume_create_manager' (2169e439-452e-440c-9fb1-31795665a4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadf8fae-9ecf-4e58-8623-1a69ca7356c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadf8fae-9ecf-4e58-8623-1a69ca7356c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-442570244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537cf49d-fb9e-4d79-85c0-341d8b2e54b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef7c2c79a244e90be04248c8ec85e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:37Z,use_quota=True,user_id='aff91a48d21841febeff106887af242e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aea0381-e790-479f-8a06-9920bca497e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aea0381-e790-479f-8a06-9920bca497e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef813d48-66ca-4c96-a419-612e61e4febd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef813d48-66ca-4c96-a419-612e61e4febd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '537cf49d-fb9e-4d79-85c0-341d8b2e54b7', 'volume_name': 'volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89beb0e-782a-4719-be2c-b53bbed70fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89beb0e-782a-4719-be2c-b53bbed70fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9679f5d7-9241-4339-a0d9-da31153eb16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Volume 537cf49d-fb9e-4d79-85c0-341d8b2e54b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7', 'volume_size': 1}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-442570244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537cf49d-fb9e-4d79-85c0-341d8b2e54b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef7c2c79a244e90be04248c8ec85e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:37Z,use_quota=True,user_id='aff91a48d21841febeff106887af242e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Creating volume 537cf49d-fb9e-4d79-85c0-341d8b2e54b7 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:36 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:37:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:37 devstack sudo[95111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7 1073741824
Nov 07 02:37:37 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:38 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7 1073741824" returned: 0 in 1.116s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:38 devstack sudo[95149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7
Nov 07 02:37:38 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:38 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7" returned: 0 in 0.417s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9679f5d7-9241-4339-a0d9-da31153eb16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc235ed-182f-4d55-8920-99c260687f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Volume volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7 (537cf49d-fb9e-4d79-85c0-341d8b2e54b7): created successfully
Nov 07 02:37:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc235ed-182f-4d55-8920-99c260687f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Flow 'volume_create_manager' (2169e439-452e-440c-9fb1-31795665a4ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3630caaf-633a-41eb-8d42-70de7ef5c4d2 tempest-VolumesListAdminTestJSON-1683348972 None] Created volume successfully.
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Flow 'volume_create_manager' (9981bf49-3c62-4967-9289-eddd1c67b091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b91db6f-b9aa-4bdc-880a-019d41db595b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b91db6f-b9aa-4bdc-880a-019d41db595b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2067396646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8213c4e9-16ad-42ec-adbb-760279c97383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef7c2c79a244e90be04248c8ec85e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:40Z,use_quota=True,user_id='aff91a48d21841febeff106887af242e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff19f46-7d3e-4908-9962-158137105f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff19f46-7d3e-4908-9962-158137105f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f31390d-cec8-447e-b54f-0a6eee20a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f31390d-cec8-447e-b54f-0a6eee20a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8213c4e9-16ad-42ec-adbb-760279c97383', 'volume_name': 'volume-8213c4e9-16ad-42ec-adbb-760279c97383', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63df3dfc-3189-4d8b-8ea7-63e9d0c04b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63df3dfc-3189-4d8b-8ea7-63e9d0c04b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6cd517-43f7-46fc-bb36-5345b0aea7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:40 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Volume 8213c4e9-16ad-42ec-adbb-760279c97383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8213c4e9-16ad-42ec-adbb-760279c97383', 'volume_size': 1}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2067396646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8213c4e9-16ad-42ec-adbb-760279c97383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef7c2c79a244e90be04248c8ec85e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:40Z,use_quota=True,user_id='aff91a48d21841febeff106887af242e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Creating volume 8213c4e9-16ad-42ec-adbb-760279c97383 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:40 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:37:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:40 devstack sudo[95197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383 1073741824
Nov 07 02:37:40 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-03fa026b-85fa-4907-ab06-0ae3b5493eea req-42c132e2-cb6e-4e1f-aaba-ca6862cd94cc tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:41 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383 1073741824" returned: 0 in 0.942s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:41 devstack sudo[95211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383
Nov 07 02:37:41 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Acquiring lock "cinder-2cfd3d98-6306-4524-b0fd-457a3b9921b9-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Lock "cinder-2cfd3d98-6306-4524-b0fd-457a3b9921b9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Acquiring lock "cinder-quobyte-2cfd3d98-6306-4524-b0fd-457a3b9921b9" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Lock "cinder-quobyte-2cfd3d98-6306-4524-b0fd-457a3b9921b9" acquired by "delete_volume" :: waited 0.048s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:41 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa77cda7-47c4-42a2-b6f4-456de7d4f864]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383" returned: 0 in 0.405s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-03fa026b-85fa-4907-ab06-0ae3b5493eea req-42c132e2-cb6e-4e1f-aaba-ca6862cd94cc tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.655s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6cd517-43f7-46fc-bb36-5345b0aea7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8213c4e9-16ad-42ec-adbb-760279c97383', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c092dd47-6704-4c4d-b8ba-cb5dd9124ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-03fa026b-85fa-4907-ab06-0ae3b5493eea req-42c132e2-cb6e-4e1f-aaba-ca6862cd94cc tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Volume volume-8213c4e9-16ad-42ec-adbb-760279c97383 (8213c4e9-16ad-42ec-adbb-760279c97383): created successfully
Nov 07 02:37:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c092dd47-6704-4c4d-b8ba-cb5dd9124ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Flow 'volume_create_manager' (9981bf49-3c62-4967-9289-eddd1c67b091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f1b53794-a466-4b1d-8af5-20aab2a1ea6a tempest-VolumesListAdminTestJSON-1683348972 None] Created volume successfully.
Nov 07 02:37:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-03fa026b-85fa-4907-ab06-0ae3b5493eea req-42c132e2-cb6e-4e1f-aaba-ca6862cd94cc tempest-TestServerVolumeAttachmentScenario-372114823 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-f1fbff0c-6675-4739-943c-33e57d7207d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31e8396e-c2cd-4785-8a28-cfc97c914caa', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:37:42 devstack sudo[95214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9
Nov 07 02:37:42 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-03fa026b-85fa-4907-ab06-0ae3b5493eea req-42c132e2-cb6e-4e1f-aaba-ca6862cd94cc tempest-TestServerVolumeAttachmentScenario-372114823 None] attachment_update completed successfully.
Nov 07 02:37:42 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9" returned: 0 in 0.635s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:42 devstack sudo[95222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9
Nov 07 02:37:42 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:43 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2cfd3d98-6306-4524-b0fd-457a3b9921b9" returned: 0 in 0.573s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Lock "cinder-quobyte-2cfd3d98-6306-4524-b0fd-457a3b9921b9" released by "delete_volume" :: held 1.308s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Created reservations ['541e168f-d7ea-43aa-814a-d0c5d041338c', '5322d070-a896-4561-95de-117141cad426', 'b226398f-599f-4830-a60a-88584b6e63fa', '566fd7a4-23b3-404a-b744-53a8647109ec'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:43 devstack sudo[95225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:37:43 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Flow 'volume_create_manager' (0fa8d06d-72b4-4cc7-af4d-aafa0c22740d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a404d05-70f1-4674-8780-577066f3137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a404d05-70f1-4674-8780-577066f3137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1176995866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc79064a-e1d6-448d-9f25-619aae81b202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef7c2c79a244e90be04248c8ec85e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:44Z,use_quota=True,user_id='aff91a48d21841febeff106887af242e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc44598c-1a94-458a-a293-43370806cff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc44598c-1a94-458a-a293-43370806cff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd70b10-ae53-4e4b-bc7c-6e0ae969f7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd70b10-ae53-4e4b-bc7c-6e0ae969f7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc79064a-e1d6-448d-9f25-619aae81b202', 'volume_name': 'volume-dc79064a-e1d6-448d-9f25-619aae81b202', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d86580-f8b0-49b5-9beb-542445616eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:43 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d86580-f8b0-49b5-9beb-542445616eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883b180e-6593-4ff5-b434-433f89963942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:44 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Volume dc79064a-e1d6-448d-9f25-619aae81b202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc79064a-e1d6-448d-9f25-619aae81b202', 'volume_size': 1}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1176995866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc79064a-e1d6-448d-9f25-619aae81b202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef7c2c79a244e90be04248c8ec85e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:44Z,use_quota=True,user_id='aff91a48d21841febeff106887af242e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Creating volume dc79064a-e1d6-448d-9f25-619aae81b202 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:44 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.503s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Deleted volume successfully.
Nov 07 02:37:44 devstack sudo[95228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202 1073741824
Nov 07 02:37:44 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d3ae617-cab5-4732-bc2a-d8d355c11f2c tempest-ServerRescueNegativeTestJSON-528331802 None] Lock "cinder-2cfd3d98-6306-4524-b0fd-457a3b9921b9-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:44 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202 1073741824" returned: 0 in 0.913s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:45 devstack sudo[95247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202
Nov 07 02:37:45 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:45 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202" returned: 0 in 0.373s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883b180e-6593-4ff5-b434-433f89963942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc79064a-e1d6-448d-9f25-619aae81b202', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d5ae28-fbbf-43f7-8614-fb3dd24740d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:45 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Volume volume-dc79064a-e1d6-448d-9f25-619aae81b202 (dc79064a-e1d6-448d-9f25-619aae81b202): created successfully
Nov 07 02:37:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d5ae28-fbbf-43f7-8614-fb3dd24740d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Flow 'volume_create_manager' (0fa8d06d-72b4-4cc7-af4d-aafa0c22740d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5583fb6e-e110-4e95-b7fa-e9a811ab8ace tempest-VolumesListAdminTestJSON-1683348972 None] Created volume successfully.
Nov 07 02:37:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-4e6f74e9-066c-45ad-b867-591f20746538 req-549b5163-edb6-484d-bb15-1ad8f42ba75e tempest-TestServerVolumeAttachmentScenario-372114823 None] Terminate volume connection completed successfully.
Nov 07 02:37:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4e6f74e9-066c-45ad-b867-591f20746538 req-549b5163-edb6-484d-bb15-1ad8f42ba75e tempest-TestServerVolumeAttachmentScenario-372114823 None] Deleting attachment 31e8396e-c2cd-4785-8a28-cfc97c914caa. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Flow 'volume_create_manager' (852582d2-a132-4177-b2ce-c00842d4fa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d43bfa5-f985-48fc-82df-8679636f89cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d43bfa5-f985-48fc-82df-8679636f89cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d113f9a2-01fe-419c-9880-0cc47d23f5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4df1c84f7e4487ae31b5ab99b85712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:48Z,use_quota=True,user_id='76fe38da517c42dd8c91e143dc5ee9a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785cc8e9-3bbb-4110-8b75-26d0f29e9da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785cc8e9-3bbb-4110-8b75-26d0f29e9da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2347b0e8-8c29-4e27-ac40-2c312fbb7685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2347b0e8-8c29-4e27-ac40-2c312fbb7685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd113f9a2-01fe-419c-9880-0cc47d23f5e0', 'volume_name': 'volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588faf7e-b21c-4dbb-8d89-a5e6eef2b66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588faf7e-b21c-4dbb-8d89-a5e6eef2b66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8895fb02-4e7b-48c7-a45a-d7838c240b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:47 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Volume d113f9a2-01fe-419c-9880-0cc47d23f5e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0', 'volume_size': 1}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d113f9a2-01fe-419c-9880-0cc47d23f5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4df1c84f7e4487ae31b5ab99b85712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:48Z,use_quota=True,user_id='76fe38da517c42dd8c91e143dc5ee9a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Creating volume d113f9a2-01fe-419c-9880-0cc47d23f5e0 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:47 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:37:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:47 devstack sudo[95300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0 1073741824
Nov 07 02:37:48 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-1cd39b93-594a-4e84-aba7-99f512b7528e req-aa0432c8-a23a-45c6-ae38-95056cf525b8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Terminate volume connection completed successfully.
Nov 07 02:37:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-1cd39b93-594a-4e84-aba7-99f512b7528e req-aa0432c8-a23a-45c6-ae38-95056cf525b8 tempest-TestServerVolumeAttachmentScenario-372114823 None] Deleting attachment 955a4d5f-d05a-4fc8-997b-4bc102ab37fc. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:37:48 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0 1073741824" returned: 0 in 0.902s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:48 devstack sudo[95309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0
Nov 07 02:37:48 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:49 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0" returned: 0 in 0.570s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8895fb02-4e7b-48c7-a45a-d7838c240b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b7661c-1e1d-49e9-93c6-1193411d2383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:49 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Volume volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0 (d113f9a2-01fe-419c-9880-0cc47d23f5e0): created successfully
Nov 07 02:37:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b7661c-1e1d-49e9-93c6-1193411d2383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Flow 'volume_create_manager' (852582d2-a132-4177-b2ce-c00842d4fa03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9025499d-002b-40be-849c-f897f06958f8 tempest-VolumesListAdminTestJSON-1426443354 None] Created volume successfully.
Nov 07 02:37:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Acquiring lock "cinder-d113f9a2-01fe-419c-9880-0cc47d23f5e0-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Lock "cinder-d113f9a2-01fe-419c-9880-0cc47d23f5e0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Acquiring lock "cinder-quobyte-d113f9a2-01fe-419c-9880-0cc47d23f5e0" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "cinder-dc79064a-e1d6-448d-9f25-619aae81b202-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Lock "cinder-quobyte-d113f9a2-01fe-419c-9880-0cc47d23f5e0" acquired by "delete_volume" :: waited 0.053s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-dc79064a-e1d6-448d-9f25-619aae81b202-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:51 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1c7415-7d0e-46fa-8a74-a8370dc81284]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "cinder-quobyte-dc79064a-e1d6-448d-9f25-619aae81b202" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-quobyte-dc79064a-e1d6-448d-9f25-619aae81b202" acquired by "delete_volume" :: waited 0.053s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:51 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dbe67a-72bd-4910-a085-bf1c680f1d7c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:51 devstack sudo[95334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0
Nov 07 02:37:51 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:51 devstack sudo[95336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202
Nov 07 02:37:51 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:52 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0" returned: 0 in 0.998s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:52 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202" returned: 0 in 0.886s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:52 devstack sudo[95352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0
Nov 07 02:37:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:52 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:52 devstack sudo[95354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202
Nov 07 02:37:52 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:52 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dc79064a-e1d6-448d-9f25-619aae81b202" returned: 0 in 0.453s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-quobyte-dc79064a-e1d6-448d-9f25-619aae81b202" released by "delete_volume" :: held 1.440s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:52 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d113f9a2-01fe-419c-9880-0cc47d23f5e0" returned: 0 in 0.572s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Lock "cinder-quobyte-d113f9a2-01fe-419c-9880-0cc47d23f5e0" released by "delete_volume" :: held 1.660s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:52 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Created reservations ['9f1a7367-9e45-4fd5-a19e-0681d8be0133', '246fbd36-c514-46fb-80a3-e871edab517c', '46e892bc-4133-4d13-af65-8fc35e3e2212', 'ba0ac728-e6ba-4d72-9b0a-3d9adb585de3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:52 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Created reservations ['209ebb7c-88ac-4ab3-8d8f-e74205b830cb', '1e7cbe8e-f79a-4769-b85f-6719f27d2601', 'f14d7c66-f5b3-4ea6-aebc-6fb629a85188', '87e4a3b8-ddbd-4718-8d5f-1b6297bd0555'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:53 devstack sudo[95376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:37:53 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:53 devstack sudo[95378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:37:53 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:53 devstack sudo[95381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:37:53 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:53 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.450s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:53 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Deleted volume successfully.
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d10044ec-3bf2-4843-85e9-13174898ea67 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-dc79064a-e1d6-448d-9f25-619aae81b202-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:53 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.478s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:53 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Deleted volume successfully.
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a12cee2-98f0-4b00-ae14-cc0e7059abef tempest-VolumesListAdminTestJSON-1426443354 None] Lock "cinder-d113f9a2-01fe-419c-9880-0cc47d23f5e0-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "cinder-8213c4e9-16ad-42ec-adbb-760279c97383-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-8213c4e9-16ad-42ec-adbb-760279c97383-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:53 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "cinder-quobyte-8213c4e9-16ad-42ec-adbb-760279c97383" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.458s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-quobyte-8213c4e9-16ad-42ec-adbb-760279c97383" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b98a7d-812e-45d7-8849-ace8f81b4caf]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:54 devstack sudo[95386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383
Nov 07 02:37:54 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:54 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383" returned: 0 in 0.524s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:54 devstack sudo[95393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383
Nov 07 02:37:54 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:54 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8213c4e9-16ad-42ec-adbb-760279c97383" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-quobyte-8213c4e9-16ad-42ec-adbb-760279c97383" released by "delete_volume" :: held 0.945s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:54 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Created reservations ['01d05e56-115d-4f33-9009-1bede4fa7d7a', 'b0ac0cda-ee61-4194-9210-9a4e22232287', '0d975ac3-a127-4abd-9b8b-28e8448cb27b', 'c2855a66-985c-46da-b149-a26f1d6d8ce7'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:55 devstack sudo[95396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:37:55 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:55 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "cinder-f1fbff0c-6675-4739-943c-33e57d7207d9-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.276s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Deleted volume successfully.
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "cinder-f1fbff0c-6675-4739-943c-33e57d7207d9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-408d8074-5f71-4175-a6c1-cd8538a4ee02 tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-8213c4e9-16ad-42ec-adbb-760279c97383-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "cinder-quobyte-f1fbff0c-6675-4739-943c-33e57d7207d9" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "cinder-quobyte-f1fbff0c-6675-4739-943c-33e57d7207d9" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5491b7-5a27-4f31-aef1-6d6aca6c49a2]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:55 devstack sudo[95399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9
Nov 07 02:37:55 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:55 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9" returned: 0 in 0.469s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:55 devstack sudo[95405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9
Nov 07 02:37:55 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "cinder-537cf49d-fb9e-4d79-85c0-341d8b2e54b7-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:56 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-537cf49d-fb9e-4d79-85c0-341d8b2e54b7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f1fbff0c-6675-4739-943c-33e57d7207d9" returned: 0 in 0.316s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "cinder-quobyte-f1fbff0c-6675-4739-943c-33e57d7207d9" released by "delete_volume" :: held 0.851s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "cinder-quobyte-537cf49d-fb9e-4d79-85c0-341d8b2e54b7" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-quobyte-537cf49d-fb9e-4d79-85c0-341d8b2e54b7" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=78,cinder:SELECT=73,cinder:INSERT=22,cinder:DELETE=10 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd046fc7-0723-42a3-9091-bedb0472aee6]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Created reservations ['8eeb4723-7bef-487d-988d-d6b720ff0bfa', '2db0345d-9b53-4707-924a-e9daae98e6e0', 'a5961428-9be3-40e3-8f43-ef8f8f3d0227', '30308339-0b9f-4fe1-972f-f3d3020afb92'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=72,cinder:INSERT=18,cinder:UPDATE=83,cinder:DELETE=4 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:56 devstack sudo[95408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7
Nov 07 02:37:56 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:56 devstack sudo[95410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:37:56 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:56 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7" returned: 0 in 0.464s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:56 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.346s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:56 devstack sudo[95417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7
Nov 07 02:37:56 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:56 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Deleted volume successfully.
Nov 07 02:37:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cfd12de2-fcd2-4ad4-908d-a94897d868f3 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "cinder-f1fbff0c-6675-4739-943c-33e57d7207d9-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:57 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-537cf49d-fb9e-4d79-85c0-341d8b2e54b7" returned: 0 in 0.296s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-quobyte-537cf49d-fb9e-4d79-85c0-341d8b2e54b7" released by "delete_volume" :: held 0.813s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Created reservations ['a50838fd-b117-4a7e-9d69-7f207e60d327', '98985a92-4fec-40de-ab74-362cabd05c1a', '9ae29662-ac04-4d70-bb24-1002134841ae', '955affb2-5bdf-4609-89e1-335cb92fd467'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:57 devstack sudo[95421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:37:57 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "cinder-74c0f497-fdd1-4b2d-913c-d36b230cc885-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "cinder-74c0f497-fdd1-4b2d-913c-d36b230cc885-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "cinder-quobyte-74c0f497-fdd1-4b2d-913c-d36b230cc885" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:57 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "cinder-quobyte-74c0f497-fdd1-4b2d-913c-d36b230cc885" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.483s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Deleted volume successfully.
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[037d00b8-01f4-4f93-aa78-77f3a4a58f98]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-039dd3bc-d333-4983-90ae-5806af0209cc tempest-VolumesListAdminTestJSON-1683348972 None] Lock "cinder-537cf49d-fb9e-4d79-85c0-341d8b2e54b7-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:57 devstack sudo[95426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885
Nov 07 02:37:57 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:58 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885" returned: 0 in 0.460s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:58 devstack sudo[95432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885
Nov 07 02:37:58 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:58 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74c0f497-fdd1-4b2d-913c-d36b230cc885" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "cinder-quobyte-74c0f497-fdd1-4b2d-913c-d36b230cc885" released by "delete_volume" :: held 0.817s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:58 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Created reservations ['7778a703-1f23-486f-bc54-d0d57916acc7', '764ae405-dd88-4b1a-8753-ffdf392863d9', 'bd3b24ae-b38e-45d2-9c58-9c27adc42ed8', 'bfb469f8-b646-4367-9d65-14aafa4aeff3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:58 devstack sudo[95435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:37:58 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:59 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.305s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:59 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Deleted volume successfully.
Nov 07 02:37:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fd4f7e5-26e1-4095-8f60-3daee8f5b752 tempest-TestServerVolumeAttachmentScenario-372114823 None] Lock "cinder-74c0f497-fdd1-4b2d-913c-d36b230cc885-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:08 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=25,cinder:SELECT=12,cinder:DELETE=1,cinder:INSERT=4 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=9,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Flow 'volume_create_manager' (97cf7c37-56fd-4315-a2b3-9147157cfc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3581fa8-d9f9-44d0-9ef6-1cd5d1ca4b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3581fa8-d9f9-44d0-9ef6-1cd5d1ca4b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1402487262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaad8b9-04f3-4949-b631-6b83f4140aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ff8acd83a64caa81323b512b00bd27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:09Z,use_quota=True,user_id='a80b693d28f8413a9985468332dfd89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91a77a8-5d7b-472d-a8cd-c9d3565413f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91a77a8-5d7b-472d-a8cd-c9d3565413f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f79ff3-a614-4204-9edf-a2aebbafed5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f79ff3-a614-4204-9edf-a2aebbafed5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3eaad8b9-04f3-4949-b631-6b83f4140aba', 'volume_name': 'volume-3eaad8b9-04f3-4949-b631-6b83f4140aba', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb2fe5d0>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daeb14c8-9d7a-4390-8f9e-5e58657d648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daeb14c8-9d7a-4390-8f9e-5e58657d648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a46f5a3-8911-4088-9eb6-6fb69687c209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Volume 3eaad8b9-04f3-4949-b631-6b83f4140aba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3eaad8b9-04f3-4949-b631-6b83f4140aba', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb2fe5d0>}
Nov 07 02:38:09 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Trying to clone 3eaad8b9-04f3-4949-b631-6b83f4140aba from image e17a9067-5798-44ad-877c-38fbc4f9665f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:38:10 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:38:10 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Image download 20.69 MB at 20.69 MB/s
Nov 07 02:38:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb443c45-60dc-47af-b7f2-3a8143aa9db5]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:10 devstack sudo[95465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD
Nov 07 02:38:10 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:10 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:10 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Temporary image e17a9067-5798-44ad-877c-38fbc4f9665f is fetched for user a80b693d28f8413a9985468332dfd89d. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:38:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[311f8ffa-3f56-4adb-a30e-4cbbb6e812f6]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:10 devstack sudo[95471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD
Nov 07 02:38:10 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:11 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1402487262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaad8b9-04f3-4949-b631-6b83f4140aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ff8acd83a64caa81323b512b00bd27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:09Z,use_quota=True,user_id='a80b693d28f8413a9985468332dfd89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Creating volume 3eaad8b9-04f3-4949-b631-6b83f4140aba {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:11 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:11 devstack sudo[95477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba 1073741824
Nov 07 02:38:11 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:11 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba 1073741824" returned: 0 in 0.479s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:11 devstack sudo[95483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba
Nov 07 02:38:11 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:11 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba" returned: 0 in 0.290s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Attempting download of e17a9067-5798-44ad-877c-38fbc4f9665f ((None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}])) to volume 3eaad8b9-04f3-4949-b631-6b83f4140aba. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a454665b-deca-4d94-a002-b6e6be196a61]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_0nhr1z51 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:12 devstack sudo[95486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_0nhr1z51
Nov 07 02:38:12 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:12 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_0nhr1z51" returned: 0 in 0.377s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_0nhr1z51 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:12 devstack sudo[95490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_0nhr1z51
Nov 07 02:38:12 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:12 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_0nhr1z51" returned: 1 in 0.341s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_0nhr1z51' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:38:12 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b2d3df-ba3e-44dd-bc33-9637491d7c4b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:12 devstack sudo[95494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD
Nov 07 02:38:12 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:13 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:13 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] e17a9067-5798-44ad-877c-38fbc4f9665f was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:38:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:13 devstack sudo[95500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba
Nov 07 02:38:13 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:15 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba" returned: 0 in 2.858s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:15 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_gb8ap4zidevstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:38:15 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Converted 112.00 MB image at 39.13 MB/s
Nov 07 02:38:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:15 devstack sudo[95564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba 1G
Nov 07 02:38:15 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:16 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba 1G" returned: 0 in 0.526s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:16 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Downloaded image e17a9067-5798-44ad-877c-38fbc4f9665f ((None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}])) to volume 3eaad8b9-04f3-4949-b631-6b83f4140aba successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:38:16 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Temporary image e17a9067-5798-44ad-877c-38fbc4f9665f for user a80b693d28f8413a9985468332dfd89d is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:38:16 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Marking volume 3eaad8b9-04f3-4949-b631-6b83f4140aba as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:38:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Copying metadata from image e17a9067-5798-44ad-877c-38fbc4f9665f to 3eaad8b9-04f3-4949-b631-6b83f4140aba. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:38:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Creating volume glance metadata for volume 3eaad8b9-04f3-4949-b631-6b83f4140aba backed by image e17a9067-5798-44ad-877c-38fbc4f9665f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:38:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a46f5a3-8911-4088-9eb6-6fb69687c209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eaad8b9-04f3-4949-b631-6b83f4140aba', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb2fe5d0>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939b9879-0293-4606-8d56-d79159dcb44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Volume volume-3eaad8b9-04f3-4949-b631-6b83f4140aba (3eaad8b9-04f3-4949-b631-6b83f4140aba): created successfully
Nov 07 02:38:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939b9879-0293-4606-8d56-d79159dcb44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Flow 'volume_create_manager' (97cf7c37-56fd-4315-a2b3-9147157cfc4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-76839844-268b-4743-a4fb-599bcdf9683f tempest-VolumesImageMetadata-440500613 None] Created volume successfully.
Nov 07 02:38:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Acquiring lock "cinder-3eaad8b9-04f3-4949-b631-6b83f4140aba-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Lock "cinder-3eaad8b9-04f3-4949-b631-6b83f4140aba-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Acquiring lock "cinder-quobyte-3eaad8b9-04f3-4949-b631-6b83f4140aba" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Lock "cinder-quobyte-3eaad8b9-04f3-4949-b631-6b83f4140aba" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75ed1a1-5c5e-47b3-83a6-99920f5f6ebb]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:18 devstack sudo[95583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba
Nov 07 02:38:18 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:18 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba" returned: 0 in 0.611s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:18 devstack sudo[95588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba
Nov 07 02:38:18 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:19 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3eaad8b9-04f3-4949-b631-6b83f4140aba" returned: 0 in 0.440s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Lock "cinder-quobyte-3eaad8b9-04f3-4949-b631-6b83f4140aba" released by "delete_volume" :: held 1.143s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:19 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Created reservations ['5042cf6e-a84c-4952-b21a-49d89ca03303', '02411faf-8b95-4a0f-ba97-5450919b88c2', '54ad5a66-eddb-461a-864a-eac7d2f6c666', '4349348d-4e5e-4639-92b5-a91d8725b698'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:19 devstack sudo[95591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:38:19 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:20 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:20 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Deleted volume successfully.
Nov 07 02:38:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d8b11302-b3cb-4e02-b0e6-08325eb483b8 tempest-VolumesImageMetadata-440500613 None] Lock "cinder-3eaad8b9-04f3-4949-b631-6b83f4140aba-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (813230f5-e0c0-4003-b382-d7bd2dbb8836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842d8fd2-e1f5-4069-97df-adafd8c48bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842d8fd2-e1f5-4069-97df-adafd8c48bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-589983871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:22Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859f9f46-2ad3-4c95-b937-de3bad0be772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859f9f46-2ad3-4c95-b937-de3bad0be772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa80fab-1a77-427d-987f-87d76a805f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa80fab-1a77-427d-987f-87d76a805f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64', 'volume_name': 'volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ff49ed-a8d1-4237-9929-558d329cde5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ff49ed-a8d1-4237-9929-558d329cde5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ab1793-42a3-47b7-94aa-13c87ac58c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Volume 31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64', 'volume_size': 1}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-589983871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:22Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Creating volume 31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:22 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:22 devstack sudo[95596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64 1073741824
Nov 07 02:38:22 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:22 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64 1073741824" returned: 0 in 0.764s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:23 devstack sudo[95602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64
Nov 07 02:38:23 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:23 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64" returned: 0 in 0.400s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ab1793-42a3-47b7-94aa-13c87ac58c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5236abb-4af6-4af3-80f3-03d651dac5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:23 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Volume volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64 (31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64): created successfully
Nov 07 02:38:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5236abb-4af6-4af3-80f3-03d651dac5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (813230f5-e0c0-4003-b382-d7bd2dbb8836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0b5bbafb-16b0-4c8b-9a09-13f3ca1ac46e tempest-VolumesActionsTest-768032875 None] Created volume successfully.
Nov 07 02:38:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1f8726d-3f09-4fdf-abd5-204425d4a18f tempest-VolumesActionsTest-768032875 None] Acquiring lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64" by "attach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1f8726d-3f09-4fdf-abd5-204425d4a18f tempest-VolumesActionsTest-768032875 None] Lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64" acquired by "attach_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a1f8726d-3f09-4fdf-abd5-204425d4a18f tempest-VolumesActionsTest-768032875 None] Attaching volume 31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64 to instance 2bfbaa12-0ad3-4b02-81d9-8741ca95a805 at mountpoint /dev/vdb on host None.
Nov 07 02:38:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a1f8726d-3f09-4fdf-abd5-204425d4a18f tempest-VolumesActionsTest-768032875 None] Attach volume completed successfully.
Nov 07 02:38:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1f8726d-3f09-4fdf-abd5-204425d4a18f tempest-VolumesActionsTest-768032875 None] Lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64" released by "attach_volume" :: held 0.169s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e9bfe9fb-0e41-4e90-b429-8d6d7854127b tempest-VolumesActionsTest-1879926632 None] Terminate volume connection completed successfully.
Nov 07 02:38:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e9bfe9fb-0e41-4e90-b429-8d6d7854127b tempest-VolumesActionsTest-1879926632 None] Acquiring lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64-detach_volume" by "detach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e9bfe9fb-0e41-4e90-b429-8d6d7854127b tempest-VolumesActionsTest-1879926632 None] Lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e9bfe9fb-0e41-4e90-b429-8d6d7854127b tempest-VolumesActionsTest-1879926632 None] Detaching volume 31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64 from instance 2bfbaa12-0ad3-4b02-81d9-8741ca95a805.
Nov 07 02:38:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e9bfe9fb-0e41-4e90-b429-8d6d7854127b tempest-VolumesActionsTest-1879926632 None] Detach volume completed successfully.
Nov 07 02:38:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e9bfe9fb-0e41-4e90-b429-8d6d7854127b tempest-VolumesActionsTest-1879926632 None] Lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ec543c40-c7d7-4878-87c2-b67b47c348d1 tempest-VolumesActionsTest-768032875 None] Acquiring lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64-detach_volume" by "detach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ec543c40-c7d7-4878-87c2-b67b47c348d1 tempest-VolumesActionsTest-768032875 None] Lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ec543c40-c7d7-4878-87c2-b67b47c348d1 tempest-VolumesActionsTest-768032875 None] Volume detach called, but volume not attached.
Nov 07 02:38:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ec543c40-c7d7-4878-87c2-b67b47c348d1 tempest-VolumesActionsTest-768032875 None] Lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64-detach_volume" released by "detach_volume" :: held 0.061s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Acquiring lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Acquiring lock "cinder-quobyte-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Lock "cinder-quobyte-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:26 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5b48ce-33d2-4707-abea-7f01641b0539]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:26 devstack sudo[95606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64
Nov 07 02:38:26 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:27 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64" returned: 0 in 0.742s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:27 devstack sudo[95611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64
Nov 07 02:38:27 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:27 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64" returned: 0 in 0.426s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Lock "cinder-quobyte-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64" released by "delete_volume" :: held 1.286s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:27 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Created reservations ['fc178617-f1ae-4837-b0ee-df746171c437', '3efdecc0-8ca5-4d14-b9fb-313a86fa76a6', 'a917baeb-624b-4667-861e-d075ca238165', '165eb67a-6c37-43da-8277-9cc3da599bc2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:28 devstack sudo[95615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:38:28 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:28 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.450s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:28 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Deleted volume successfully.
Nov 07 02:38:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-46bfb743-de7f-4b56-8b0d-741ce5807827 tempest-VolumesActionsTest-768032875 None] Lock "cinder-31c5c12b-e9ff-4367-9f8a-22aa6b6a3d64-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (bd6411a1-70fc-4ae5-a567-cd3bde4935c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca2fec9-5b00-4184-857b-e5683d3d9ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca2fec9-5b00-4184-857b-e5683d3d9ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-562820497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8886dbd9-a874-4a4e-a235-da10a5dd55f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:35Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2a08d3-b97a-413b-97f8-dea86834e8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2a08d3-b97a-413b-97f8-dea86834e8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5609cd6e-95b7-42ca-b3ae-9414b51d5990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5609cd6e-95b7-42ca-b3ae-9414b51d5990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8886dbd9-a874-4a4e-a235-da10a5dd55f9', 'volume_name': 'volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243ed9ec-a1d0-45ab-8534-7f951b015d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243ed9ec-a1d0-45ab-8534-7f951b015d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf9112f-2020-4ba7-8f00-c7aefeb1479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Volume 8886dbd9-a874-4a4e-a235-da10a5dd55f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9', 'volume_size': 1}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-562820497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8886dbd9-a874-4a4e-a235-da10a5dd55f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:35Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Creating volume 8886dbd9-a874-4a4e-a235-da10a5dd55f9 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:35 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:38:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:35 devstack sudo[95684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9 1073741824
Nov 07 02:38:35 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Flow 'volume_create_manager' (4b1a7ca3-b6b5-4d95-82ab-4710fd5dc77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c167dc-901b-485c-86e5-5cafcfe3dac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c167dc-901b-485c-86e5-5cafcfe3dac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-758906485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fa4a19-2c99-425b-88af-fdff8fbeb5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a6aa05c4fa4a3484c7b6f70af85a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:36Z,use_quota=True,user_id='982cc70f725d4f38960dcd90c1c62f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bd1151-c71a-41c2-93a7-47c00cf240d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bd1151-c71a-41c2-93a7-47c00cf240d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84894d26-2f42-489b-9f67-34b31f4b615d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:38:36 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9 1073741824" returned: 0 in 1.072s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:36 devstack sudo[95691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9
Nov 07 02:38:36 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84894d26-2f42-489b-9f67-34b31f4b615d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '64fa4a19-2c99-425b-88af-fdff8fbeb5ff', 'volume_name': 'volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb4b6a80>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b65ec7-24af-4957-b55c-667af4df1e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b65ec7-24af-4957-b55c-667af4df1e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9c570c-6278-4be4-a623-d8befd6f0ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Volume 64fa4a19-2c99-425b-88af-fdff8fbeb5ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb4b6a80>}
Nov 07 02:38:36 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Trying to clone 64fa4a19-2c99-425b-88af-fdff8fbeb5ff from image e17a9067-5798-44ad-877c-38fbc4f9665f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:38:37 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9" returned: 0 in 0.506s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf9112f-2020-4ba7-8f00-c7aefeb1479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f31e4ca-17d8-448c-a657-82dabcd992d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Volume volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9 (8886dbd9-a874-4a4e-a235-da10a5dd55f9): created successfully
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f31e4ca-17d8-448c-a657-82dabcd992d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (bd6411a1-70fc-4ae5-a567-cd3bde4935c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-eedd3116-afb7-4a1c-961c-a85b75217057 tempest-VolumesActionsTest-768032875 None] Created volume successfully.
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:38:37 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Image download 20.69 MB at 20.69 MB/s
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3af772e-60d0-4ba6-a7ff-f6c5e07f3bfa]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:37 devstack sudo[95697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD
Nov 07 02:38:37 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Acquiring lock "cinder-8886dbd9-a874-4a4e-a235-da10a5dd55f9-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Lock "cinder-8886dbd9-a874-4a4e-a235-da10a5dd55f9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Acquiring lock "cinder-quobyte-8886dbd9-a874-4a4e-a235-da10a5dd55f9" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Lock "cinder-quobyte-8886dbd9-a874-4a4e-a235-da10a5dd55f9" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[64de54c0-cd60-41fd-a48f-b7f62ddba31b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:38 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Temporary image e17a9067-5798-44ad-877c-38fbc4f9665f is fetched for user 982cc70f725d4f38960dcd90c1c62f50. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7ac840-9721-45f5-a3a7-f781d11c58dc]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:38 devstack sudo[95712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9
Nov 07 02:38:38 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:38 devstack sudo[95716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD
Nov 07 02:38:38 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:38 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-758906485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fa4a19-2c99-425b-88af-fdff8fbeb5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a6aa05c4fa4a3484c7b6f70af85a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:36Z,use_quota=True,user_id='982cc70f725d4f38960dcd90c1c62f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:38 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Creating volume 64fa4a19-2c99-425b-88af-fdff8fbeb5ff {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:38 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9" returned: 0 in 0.644s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:38 devstack sudo[95727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff 1073741824
Nov 07 02:38:38 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:38 devstack sudo[95728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9
Nov 07 02:38:38 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:39 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8886dbd9-a874-4a4e-a235-da10a5dd55f9" returned: 0 in 0.485s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Lock "cinder-quobyte-8886dbd9-a874-4a4e-a235-da10a5dd55f9" released by "delete_volume" :: held 1.236s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Created reservations ['7690a6f2-f730-4d7a-b626-9c2c7b2385bf', '149f1ac8-ba6d-44d0-9f72-d8556bfe50c7', '48120b4b-6464-4220-9545-a5febd3db6e1', '9bab79da-1911-4437-a13d-6a9226f43738'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:39 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff 1073741824" returned: 0 in 0.706s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:39 devstack sudo[95739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:38:39 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:39 devstack sudo[95741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff
Nov 07 02:38:39 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:39 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.321s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Deleted volume successfully.
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9dc481a3-55fc-4a0e-b74b-8f6f5512bf9b tempest-VolumesActionsTest-1879926632 None] Lock "cinder-8886dbd9-a874-4a4e-a235-da10a5dd55f9-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:39 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff" returned: 0 in 0.328s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Attempting download of e17a9067-5798-44ad-877c-38fbc4f9665f ((None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}])) to volume 64fa4a19-2c99-425b-88af-fdff8fbeb5ff. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca29c5e3-ce3b-482a-b25c-abfd20597289]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_kz875bc8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:40 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_kz875bc8
Nov 07 02:38:40 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:40 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_kz875bc8" returned: 0 in 0.391s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_kz875bc8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:40 devstack sudo[95749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_kz875bc8
Nov 07 02:38:40 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:40 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_kz875bc8" returned: 1 in 0.483s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_kz875bc8' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f270500-173f-4dba-ac46-e9c5c74b64e1]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (937cb887-e39f-4d4c-baf9-b15c22723ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3aec9af-9f5c-4731-ae4e-85541e2d9571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3aec9af-9f5c-4731-ae4e-85541e2d9571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-472523134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162e66d7-ec74-4d6e-adbc-878d35d7b16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:41Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5757270d-1873-4b24-bf98-aa515a69cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5757270d-1873-4b24-bf98-aa515a69cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d8f433-a7dd-4190-96fa-812562a6aa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d8f433-a7dd-4190-96fa-812562a6aa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '162e66d7-ec74-4d6e-adbc-878d35d7b16a', 'volume_name': 'volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10062e7d-14bb-4389-94ae-ade1d45a4868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10062e7d-14bb-4389-94ae-ade1d45a4868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f05dfa9-4336-43c6-91fa-3ea8a1a64949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:40 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Volume 162e66d7-ec74-4d6e-adbc-878d35d7b16a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a', 'volume_size': 1}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-472523134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162e66d7-ec74-4d6e-adbc-878d35d7b16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:41Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Creating volume 162e66d7-ec74-4d6e-adbc-878d35d7b16a {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:40 devstack sudo[95753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD
Nov 07 02:38:40 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:40 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:38:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:41 devstack sudo[95755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a 1073741824
Nov 07 02:38:41 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:41 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:41 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] e17a9067-5798-44ad-877c-38fbc4f9665f was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:38:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:41 devstack sudo[95765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff
Nov 07 02:38:41 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:41 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a 1073741824" returned: 0 in 0.648s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:41 devstack sudo[95771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a
Nov 07 02:38:41 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:42 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a" returned: 0 in 0.430s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f05dfa9-4336-43c6-91fa-3ea8a1a64949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bb21ae-9dce-463b-825e-2c1766585ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Volume volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a (162e66d7-ec74-4d6e-adbc-878d35d7b16a): created successfully
Nov 07 02:38:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bb21ae-9dce-463b-825e-2c1766585ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (937cb887-e39f-4d4c-baf9-b15c22723ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a7790587-6740-4e98-948f-5609a637a73c tempest-VolumesActionsTest-768032875 None] Created volume successfully.
Nov 07 02:38:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Acquiring lock "cinder-162e66d7-ec74-4d6e-adbc-878d35d7b16a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-162e66d7-ec74-4d6e-adbc-878d35d7b16a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Acquiring lock "cinder-quobyte-162e66d7-ec74-4d6e-adbc-878d35d7b16a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-quobyte-162e66d7-ec74-4d6e-adbc-878d35d7b16a" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6533e802-be8b-4b31-aa9d-f75fc72739cf]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:43 devstack sudo[95843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a
Nov 07 02:38:43 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:44 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a" returned: 0 in 0.822s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:44 devstack sudo[95852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a
Nov 07 02:38:44 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:44 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-162e66d7-ec74-4d6e-adbc-878d35d7b16a" returned: 0 in 0.519s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-quobyte-162e66d7-ec74-4d6e-adbc-878d35d7b16a" released by "delete_volume" :: held 1.429s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:44 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff" returned: 0 in 3.633s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:44 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_jt93pegmdevstack@QuobyteHD, size 112.00 MB, duration 3.64 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:38:44 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Converted 112.00 MB image at 30.80 MB/s
Nov 07 02:38:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:45 devstack sudo[95855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff 1G
Nov 07 02:38:45 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Created reservations ['26cebf22-36aa-422d-8141-9ce45782af2d', '7328b726-5960-4d43-b873-05e7b43d5583', '399c9df9-ce2b-42a2-ad57-d16db81bfe23', 'd49934d6-b356-4c13-af9d-2ad6022cf83a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:45 devstack sudo[95857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:38:45 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:45 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff 1G" returned: 0 in 0.499s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Downloaded image e17a9067-5798-44ad-877c-38fbc4f9665f ((None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}])) to volume 64fa4a19-2c99-425b-88af-fdff8fbeb5ff successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:38:45 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Temporary image e17a9067-5798-44ad-877c-38fbc4f9665f for user 982cc70f725d4f38960dcd90c1c62f50 is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Marking volume 64fa4a19-2c99-425b-88af-fdff8fbeb5ff as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.355s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Deleted volume successfully.
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Copying metadata from image e17a9067-5798-44ad-877c-38fbc4f9665f to 64fa4a19-2c99-425b-88af-fdff8fbeb5ff. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Creating volume glance metadata for volume 64fa4a19-2c99-425b-88af-fdff8fbeb5ff backed by image e17a9067-5798-44ad-877c-38fbc4f9665f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-eedd9eb4-3c0f-464f-9e26-4577770f9092 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-162e66d7-ec74-4d6e-adbc-878d35d7b16a-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9c570c-6278-4be4-a623-d8befd6f0ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb4b6a80>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e415ffda-c859-4aad-9830-715a575956ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:45 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Volume volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff (64fa4a19-2c99-425b-88af-fdff8fbeb5ff): created successfully
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e415ffda-c859-4aad-9830-715a575956ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Flow 'volume_create_manager' (4b1a7ca3-b6b5-4d95-82ab-4710fd5dc77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-165bd661-b931-4dda-ba2a-fed4e8f7352b tempest-VolumesExtendTest-231386980 None] Created volume successfully.
Nov 07 02:38:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-87b2a00d-747b-4b8f-bac9-96c6ac0e4b15 tempest-VolumesExtendTest-231386980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-87b2a00d-747b-4b8f-bac9-96c6ac0e4b15 tempest-VolumesExtendTest-231386980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37814b3-3c33-42a2-993a-5ec1746886fb]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87b2a00d-747b-4b8f-bac9-96c6ac0e4b15 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:46 devstack sudo[95871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff
Nov 07 02:38:46 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:46 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (05148d87-dc7a-4519-b6d8-74750b9963c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:47 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd7a233-d126-43ac-b3a8-c0a1bc4d50c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87b2a00d-747b-4b8f-bac9-96c6ac0e4b15 tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff" returned: 0 in 0.522s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87b2a00d-747b-4b8f-bac9-96c6ac0e4b15 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff 2G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd7a233-d126-43ac-b3a8-c0a1bc4d50c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-195854513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4acb2df-0f74-4344-a03b-9a877ea1e0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:47Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5aec87a-7f18-4e18-8a53-8dcddeb84739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5aec87a-7f18-4e18-8a53-8dcddeb84739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd5055c-d7f0-4b1a-906a-c80dff799d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd5055c-d7f0-4b1a-906a-c80dff799d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4acb2df-0f74-4344-a03b-9a877ea1e0ec', 'volume_name': 'volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118539c0-cbef-4879-a401-8cdaefa80f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118539c0-cbef-4879-a401-8cdaefa80f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426bad28-ff12-496b-acb4-ffcb0ab35489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:47 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Volume c4acb2df-0f74-4344-a03b-9a877ea1e0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec', 'volume_size': 1}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87b2a00d-747b-4b8f-bac9-96c6ac0e4b15 tempest-VolumesExtendTest-231386980 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff 2G" returned: 0 in 0.181s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-87b2a00d-747b-4b8f-bac9-96c6ac0e4b15 tempest-VolumesExtendTest-231386980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.780s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.107s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-195854513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4acb2df-0f74-4344-a03b-9a877ea1e0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:47Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Creating volume c4acb2df-0f74-4344-a03b-9a877ea1e0ec {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:47 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:38:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:47 devstack sudo[95880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec 1073741824
Nov 07 02:38:47 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-87b2a00d-747b-4b8f-bac9-96c6ac0e4b15 tempest-VolumesExtendTest-231386980 None] Extend volume completed successfully.
Nov 07 02:38:48 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec 1073741824" returned: 0 in 0.793s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:48 devstack sudo[95888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec
Nov 07 02:38:48 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:48 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Acquiring lock "cinder-64fa4a19-2c99-425b-88af-fdff8fbeb5ff-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426bad28-ff12-496b-acb4-ffcb0ab35489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96a3cf2-1be7-4dce-86ed-52815a49b776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:48 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Volume volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec (c4acb2df-0f74-4344-a03b-9a877ea1e0ec): created successfully
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96a3cf2-1be7-4dce-86ed-52815a49b776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (05148d87-dc7a-4519-b6d8-74750b9963c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Lock "cinder-64fa4a19-2c99-425b-88af-fdff8fbeb5ff-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fbcbb057-6cb3-48e8-8dd8-7793a92a37c7 tempest-VolumesActionsTest-768032875 None] Created volume successfully.
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Acquiring lock "cinder-quobyte-64fa4a19-2c99-425b-88af-fdff8fbeb5ff" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Lock "cinder-quobyte-64fa4a19-2c99-425b-88af-fdff8fbeb5ff" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2b34cd-465a-424d-a1ea-5f4be8767c52]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:48 devstack sudo[95891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff
Nov 07 02:38:48 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:49 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff" returned: 0 in 0.523s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:49 devstack sudo[95897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff
Nov 07 02:38:49 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Acquiring lock "cinder-c4acb2df-0f74-4344-a03b-9a877ea1e0ec-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-c4acb2df-0f74-4344-a03b-9a877ea1e0ec-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Acquiring lock "cinder-quobyte-c4acb2df-0f74-4344-a03b-9a877ea1e0ec" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-quobyte-c4acb2df-0f74-4344-a03b-9a877ea1e0ec" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3993af-d257-4104-861d-c94dcd323efb]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:49 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-64fa4a19-2c99-425b-88af-fdff8fbeb5ff" returned: 0 in 0.540s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:49 devstack sudo[95899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec
Nov 07 02:38:49 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Lock "cinder-quobyte-64fa4a19-2c99-425b-88af-fdff8fbeb5ff" released by "delete_volume" :: held 1.130s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:49 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Created reservations ['7bd01c13-0b39-482d-a7a8-722a977b1db4', '3d8e064f-af34-4873-9d2a-59ef3b5b7f17', 'fb63b279-24e5-4b5b-9bff-733556c879a7', '4f52ea6c-fb39-4c9b-88f1-b599b2de96eb'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:50 devstack sudo[95904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:38:50 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:50 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec" returned: 0 in 0.662s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:50 devstack sudo[95907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec
Nov 07 02:38:50 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:50 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.346s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Deleted volume successfully.
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a0739171-6c6b-4c26-a9ef-d98b28a6a857 tempest-VolumesExtendTest-231386980 None] Lock "cinder-64fa4a19-2c99-425b-88af-fdff8fbeb5ff-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:50 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c4acb2df-0f74-4344-a03b-9a877ea1e0ec" returned: 0 in 0.561s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-quobyte-c4acb2df-0f74-4344-a03b-9a877ea1e0ec" released by "delete_volume" :: held 1.311s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:50 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Created reservations ['7b570cd1-d14d-4736-981b-fe70e15152b0', '1112b556-1be9-468b-931d-195890bb862d', 'd4152ada-eae6-4897-aa0b-69b7242bfcbb', 'd4e81ea2-c043-43d5-b43b-908062e4f44d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:51 devstack sudo[95912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:38:51 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:51 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.643s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:51 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Deleted volume successfully.
Nov 07 02:38:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8445a1fb-8e07-4b42-8d1c-110546a2b676 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-c4acb2df-0f74-4344-a03b-9a877ea1e0ec-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:51 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Flow 'volume_create_manager' (9114e81b-ecb8-4f23-b1c1-55f067cb3971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d007f7b-0628-4c63-827d-dd713f26b211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d007f7b-0628-4c63-827d-dd713f26b211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-774475389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe9e47f-d03d-4862-9317-9fb7d99e0aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a6aa05c4fa4a3484c7b6f70af85a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:52Z,use_quota=True,user_id='982cc70f725d4f38960dcd90c1c62f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dda5ab-2239-4e47-a98b-e2004f1adef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dda5ab-2239-4e47-a98b-e2004f1adef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36d490b-0630-456b-82d7-fcad54ea12f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36d490b-0630-456b-82d7-fcad54ea12f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe9e47f-d03d-4862-9317-9fb7d99e0aa7', 'volume_name': 'volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bd35b7-9100-4ec1-9d88-d6ebec42bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bd35b7-9100-4ec1-9d88-d6ebec42bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60251f8b-1a2e-44b2-86a4-410aad262642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:52 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Volume 4fe9e47f-d03d-4862-9317-9fb7d99e0aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7', 'volume_size': 1}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-774475389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe9e47f-d03d-4862-9317-9fb7d99e0aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a6aa05c4fa4a3484c7b6f70af85a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:52Z,use_quota=True,user_id='982cc70f725d4f38960dcd90c1c62f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Creating volume 4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:52 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:52 devstack sudo[95916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 1073741824
Nov 07 02:38:52 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (6e8951e4-a4ae-464f-8679-ea2bb87edf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b352c5-4a9b-490c-a79c-ad409b89e4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:53 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b352c5-4a9b-490c-a79c-ad409b89e4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2040637323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204aaee6-3b94-4b33-a4d4-aa56ac7b129c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:53Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8c8648-c21e-43ca-a1d6-f8978d01cda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8c8648-c21e-43ca-a1d6-f8978d01cda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290e8a03-eeba-41b6-8485-b7d5dcf08d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290e8a03-eeba-41b6-8485-b7d5dcf08d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '204aaee6-3b94-4b33-a4d4-aa56ac7b129c', 'volume_name': 'volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3526b69a-7c49-47d7-850c-760b02f0a4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3526b69a-7c49-47d7-850c-760b02f0a4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d74765a-d6cd-410d-94ba-53e3105becca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Volume 204aaee6-3b94-4b33-a4d4-aa56ac7b129c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c', 'volume_size': 1}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 1073741824" returned: 0 in 0.890s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:53 devstack sudo[95922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7
Nov 07 02:38:53 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:53 devstack sudo[95925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:38:53 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:53 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.345s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:38:53 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" returned: 0 in 0.723s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2040637323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204aaee6-3b94-4b33-a4d4-aa56ac7b129c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:53Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Creating volume 204aaee6-3b94-4b33-a4d4-aa56ac7b129c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:53 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60251f8b-1a2e-44b2-86a4-410aad262642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:53 devstack sudo[95929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c 1073741824
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccf01b1-9621-4483-b593-ff3e439254a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:53 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Volume volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 (4fe9e47f-d03d-4862-9317-9fb7d99e0aa7): created successfully
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccf01b1-9621-4483-b593-ff3e439254a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Flow 'volume_create_manager' (9114e81b-ecb8-4f23-b1c1-55f067cb3971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:53 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-33425660-3ed4-4bec-88c8-d588f8c9ea8f tempest-VolumesExtendTest-231386980 None] Created volume successfully.
Nov 07 02:38:54 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c 1073741824" returned: 0 in 0.637s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:54 devstack sudo[95935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c
Nov 07 02:38:54 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:54 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c" returned: 0 in 0.328s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d74765a-d6cd-410d-94ba-53e3105becca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b2a6d3-54df-40f7-95cf-d68ee71fae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:54 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Volume volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c (204aaee6-3b94-4b33-a4d4-aa56ac7b129c): created successfully
Nov 07 02:38:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b2a6d3-54df-40f7-95cf-d68ee71fae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (6e8951e4-a4ae-464f-8679-ea2bb87edf88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1bf0d9fb-e0cc-477a-93ca-c4f60dcb4a72 tempest-VolumesActionsTest-768032875 None] Created volume successfully.
Nov 07 02:38:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] Creating offline snapshot 79b190a2-e8c3-470f-bbaa-bc853f860977 of volume 4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:38:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7102710e-5db8-4014-bf75-7ec8066077c3]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:55 devstack sudo[95938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7
Nov 07 02:38:55 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:55 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" returned: 0 in 0.516s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:55 devstack sudo[95943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 1G
Nov 07 02:38:55 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Acquiring lock "cinder-204aaee6-3b94-4b33-a4d4-aa56ac7b129c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:56 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 1G" returned: 0 in 0.613s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-204aaee6-3b94-4b33-a4d4-aa56ac7b129c-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:56 devstack sudo[95957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977
Nov 07 02:38:56 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Acquiring lock "cinder-quobyte-204aaee6-3b94-4b33-a4d4-aa56ac7b129c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-quobyte-204aaee6-3b94-4b33-a4d4-aa56ac7b129c" acquired by "delete_volume" :: waited 0.047s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab8a1d-c0ea-439d-84db-dffef6a2f399]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:56 devstack sudo[95993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c
Nov 07 02:38:56 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:56 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977" returned: 0 in 0.446s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:56 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 is being set with open permissions: ugo+rw
Nov 07 02:38:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:56 devstack sudo[95999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977
Nov 07 02:38:56 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:57 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c" returned: 0 in 0.426s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:57 devstack sudo[96004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c
Nov 07 02:38:57 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:57 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:57 devstack sudo[96007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.info
Nov 07 02:38:57 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:57 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-204aaee6-3b94-4b33-a4d4-aa56ac7b129c" returned: 0 in 0.344s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-quobyte-204aaee6-3b94-4b33-a4d4-aa56ac7b129c" released by "delete_volume" :: held 0.839s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:57 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.info" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:57 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.info is being set with open permissions: ugo+rw
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:57 devstack sudo[96012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.info
Nov 07 02:38:57 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Created reservations ['90f1dc0a-8080-4415-948d-3ef998410057', '368873d2-29e4-4ac9-a8a8-9f0203cdb948', 'f32743cd-96a2-4fa9-8e47-f450d960b585', '91a22df3-e272-415d-816b-6890902e5a85'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:57 devstack sudo[96015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:38:57 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:57 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.info" returned: 0 in 0.300s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.591s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c9be7bf8-3e24-4aee-9e0c-62fdf51308c8 tempest-VolumesExtendTest-231386980 None] Create snapshot completed successfully
Nov 07 02:38:57 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Deleted volume successfully.
Nov 07 02:38:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c62b0e6-8014-4692-96c9-6ea57d6c2790 tempest-VolumesActionsTest-1879926632 None] Lock "cinder-204aaee6-3b94-4b33-a4d4-aa56ac7b129c-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Flow 'volume_create_manager' (1e076411-2d87-479a-848d-73e84e501a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe71667-b409-4dd4-8cd2-01179b35993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe71667-b409-4dd4-8cd2-01179b35993f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1682444560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c843494-f39b-449a-9115-11ed39fc8363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c033a9e7e9b54ddd9f4fad122b4d0119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:58Z,use_quota=True,user_id='cf75c517ef344018ab916ae4ff49f70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7bc104-b1b7-4404-8ebf-ad4381b28a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7bc104-b1b7-4404-8ebf-ad4381b28a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0affb0c1-ea83-499a-91d1-c64ab0c03a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4abdd8c2-9ec8-4d76-9d7c-72a54422b519 tempest-VolumesExtendTest-231386980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4abdd8c2-9ec8-4d76-9d7c-72a54422b519 tempest-VolumesExtendTest-231386980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b5f6af-6d41-4292-9251-28d11473eb9f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4abdd8c2-9ec8-4d76-9d7c-72a54422b519 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:58 devstack sudo[96019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7
Nov 07 02:38:58 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0affb0c1-ea83-499a-91d1-c64ab0c03a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c843494-f39b-449a-9115-11ed39fc8363', 'volume_name': 'volume-6c843494-f39b-449a-9115-11ed39fc8363', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fbdd51c0>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da81264f-5cd8-46f4-8bd9-26f9840303b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da81264f-5cd8-46f4-8bd9-26f9840303b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45458fc-89c2-4fed-ab9f-2d960f0289a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Volume 6c843494-f39b-449a-9115-11ed39fc8363: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c843494-f39b-449a-9115-11ed39fc8363', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fbdd51c0>}
Nov 07 02:38:58 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Trying to clone 6c843494-f39b-449a-9115-11ed39fc8363 from image e17a9067-5798-44ad-877c-38fbc4f9665f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:38:59 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4abdd8c2-9ec8-4d76-9d7c-72a54422b519 tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" returned: 0 in 0.456s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4abdd8c2-9ec8-4d76-9d7c-72a54422b519 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 2G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:38:59 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Image download 20.69 MB at 20.69 MB/s
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4abdd8c2-9ec8-4d76-9d7c-72a54422b519 tempest-VolumesExtendTest-231386980 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 2G" returned: 0 in 0.203s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4abdd8c2-9ec8-4d76-9d7c-72a54422b519 tempest-VolumesExtendTest-231386980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.722s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[babb5d30-79e4-4d9d-a847-94dd40c7bcea]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (4ac51d90-4fc3-4c99-87b1-77fd2c88e312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571cd781-a6ae-48a4-8648-e71e3fb54c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4abdd8c2-9ec8-4d76-9d7c-72a54422b519 tempest-VolumesExtendTest-231386980 None] Extend volume completed successfully.
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571cd781-a6ae-48a4-8648-e71e3fb54c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-270383057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62035f4-bf71-4dd2-b535-505e500ec220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:59Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f57475-43bd-4bff-853b-4c4aded8285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f57475-43bd-4bff-853b-4c4aded8285e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eab554f-dcc6-49cb-8f27-8f7335adda41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eab554f-dcc6-49cb-8f27-8f7335adda41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62035f4-bf71-4dd2-b535-505e500ec220', 'volume_name': 'volume-f62035f4-bf71-4dd2-b535-505e500ec220', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e67227-3b5b-448d-a616-d56dbd8deb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e67227-3b5b-448d-a616-d56dbd8deb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c06c4-1cd1-4d6a-beef-d4644a0ecff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Volume f62035f4-bf71-4dd2-b535-505e500ec220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62035f4-bf71-4dd2-b535-505e500ec220', 'volume_size': 1}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-270383057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62035f4-bf71-4dd2-b535-505e500ec220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdaea1787f4dd3960cbf9e52e8675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:59Z,use_quota=True,user_id='d4ab47ba17c3452fa900c6e7c42bde9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Creating volume f62035f4-bf71-4dd2-b535-505e500ec220 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:59 devstack sudo[96028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:59 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:59 devstack sudo[96030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220 1073741824
Nov 07 02:38:59 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:59 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Temporary image e17a9067-5798-44ad-877c-38fbc4f9665f is fetched for user cf75c517ef344018ab916ae4ff49f70e. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5715fa57-7f28-4c38-9b2f-9640b256e821]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Acquiring lock "cinder-79b190a2-e8c3-470f-bbaa-bc853f860977-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Lock "cinder-79b190a2-e8c3-470f-bbaa-bc853f860977-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Acquiring lock "cinder-quobyte-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Lock "cinder-quobyte-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Acquiring lock "cinder-quobyte-79b190a2-e8c3-470f-bbaa-bc853f860977" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Lock "cinder-quobyte-79b190a2-e8c3-470f-bbaa-bc853f860977" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Deleting offline snapshot 79b190a2-e8c3-470f-bbaa-bc853f860977 of volume 4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] snapshot_file for this snap is: volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:38:59 devstack sudo[96038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD
Nov 07 02:38:59 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a572445-1dd5-4e45-9c5a-f3d803739452]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:59 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220 1073741824" returned: 0 in 0.514s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:59 devstack sudo[96042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220
Nov 07 02:38:59 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:00 devstack sudo[96041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977
Nov 07 02:39:00 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:00 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:00 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220" returned: 0 in 0.254s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.109s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1682444560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c843494-f39b-449a-9115-11ed39fc8363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c033a9e7e9b54ddd9f4fad122b4d0119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:58Z,use_quota=True,user_id='cf75c517ef344018ab916ae4ff49f70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Creating volume 6c843494-f39b-449a-9115-11ed39fc8363 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:00 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c06c4-1cd1-4d6a-beef-d4644a0ecff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62035f4-bf71-4dd2-b535-505e500ec220', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7bd3ca-e673-4195-b85c-4962ba8859aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:00 devstack sudo[96052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363 1073741824
Nov 07 02:39:00 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:00 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:00 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Volume volume-f62035f4-bf71-4dd2-b535-505e500ec220 (f62035f4-bf71-4dd2-b535-505e500ec220): created successfully
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7bd3ca-e673-4195-b85c-4962ba8859aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Flow 'volume_create_manager' (4ac51d90-4fc3-4c99-87b1-77fd2c88e312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977" returned: 0 in 0.408s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:39:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d10cb296-f185-4890-ba3f-f99ee0e7121b tempest-VolumesActionsTest-768032875 None] Created volume successfully.
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8174315e-c2f5-40d0-94af-e238a6c6a115]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:00 devstack sudo[96054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7
Nov 07 02:39:00 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:00 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363 1073741824" returned: 0 in 0.439s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:00 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:00 devstack sudo[96062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:00 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:00 devstack sudo[96064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977
Nov 07 02:39:00 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:00 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363" returned: 0 in 0.262s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Attempting download of e17a9067-5798-44ad-877c-38fbc4f9665f ((None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}])) to volume 6c843494-f39b-449a-9115-11ed39fc8363. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cb179c-5894-4255-83ba-3f246323bc2b]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_xvo3lo1o {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:01 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977" returned: 0 in 0.395s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:01 devstack sudo[96070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_xvo3lo1o
Nov 07 02:39:01 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:01 devstack sudo[96071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977
Nov 07 02:39:01 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:01 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_xvo3lo1o" returned: 0 in 0.350s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_xvo3lo1o {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:01 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7.79b190a2-e8c3-470f-bbaa-bc853f860977" returned: 0 in 0.333s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Lock "cinder-quobyte-79b190a2-e8c3-470f-bbaa-bc853f860977" released by "_delete_snapshot" :: held 1.679s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:01 devstack sudo[96077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_xvo3lo1o
Nov 07 02:39:01 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Lock "cinder-quobyte-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" released by "delete_snapshot" :: held 1.701s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Created reservations ['4b17553b-face-45c3-88bb-8326b070cca1', '4a99734b-4aa8-47ce-bf0e-09e7da2f8860', 'fb3f5389-5d0d-4407-8a62-7f495d2e208a', 'ad10b79a-7e19-4f2b-844b-fe8e78e2d88b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Delete snapshot completed successfully.
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a6f1b9c-97f5-412d-bd81-3870e8b39a79 tempest-VolumesExtendTest-231386980 None] Lock "cinder-79b190a2-e8c3-470f-bbaa-bc853f860977-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:01 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_xvo3lo1o" returned: 1 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_xvo3lo1o' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c653b9bc-8ab3-4e9d-808e-2bab2509f0b5]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:01 devstack sudo[96081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD
Nov 07 02:39:01 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Acquiring lock "cinder-f62035f4-bf71-4dd2-b535-505e500ec220-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Lock "cinder-f62035f4-bf71-4dd2-b535-505e500ec220-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Acquiring lock "cinder-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Lock "cinder-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Acquiring lock "cinder-quobyte-f62035f4-bf71-4dd2-b535-505e500ec220" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Lock "cinder-quobyte-f62035f4-bf71-4dd2-b535-505e500ec220" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Acquiring lock "cinder-quobyte-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Lock "cinder-quobyte-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c5de4a-18fe-4b4e-8c30-7eaa7d03d8f9]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:02 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb32858-7e33-4127-adba-b59129d782d2]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] e17a9067-5798-44ad-877c-38fbc4f9665f was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:02 devstack sudo[96089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363
Nov 07 02:39:02 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:02 devstack sudo[96087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220
Nov 07 02:39:02 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:02 devstack sudo[96088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7
Nov 07 02:39:02 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:02 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220" returned: 0 in 0.413s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:02 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:02 devstack sudo[96102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" returned: 0 in 0.428s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:02 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:02 devstack sudo[96104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7
Nov 07 02:39:02 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:02 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f62035f4-bf71-4dd2-b535-505e500ec220" returned: 0 in 0.297s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Lock "cinder-quobyte-f62035f4-bf71-4dd2-b535-505e500ec220" released by "delete_volume" :: held 0.808s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:02 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Lock "cinder-quobyte-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7" released by "delete_volume" :: held 0.827s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Created reservations ['71fe07fb-46cb-4969-b993-c00790e4ecd0', 'dffad0a4-4632-44e9-868d-7454e9799d52', '04f2b047-0a86-4d06-a118-333f474e4828', '6687c3fe-ef0a-48af-aa5f-5c8f7ab93080'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Created reservations ['3a54f765-a32d-4af8-9a4e-4ca4869e7a2a', 'af003054-e2c5-452a-9f95-01f54fdcc35f', '8a8a914a-e250-49bd-b27b-f3346891ee58', '07ae1c33-bfa4-4dc6-b834-0078f4c9b883'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:03 devstack sudo[96111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:39:03 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:03 devstack sudo[96113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:39:03 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:03 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.552s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:03 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Deleted volume successfully.
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.687s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Deleted volume successfully.
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f4cbd3e4-6ab5-46c5-812e-65e6fff6073b tempest-VolumesExtendTest-231386980 None] Lock "cinder-4fe9e47f-d03d-4862-9317-9fb7d99e0aa7-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8e08b655-f783-4ce1-9f16-d472c844fa78 tempest-VolumesActionsTest-768032875 None] Lock "cinder-f62035f4-bf71-4dd2-b535-505e500ec220-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:05 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363" returned: 0 in 2.982s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_at6tg4wudevstack@QuobyteHD, size 112.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:39:05 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Converted 112.00 MB image at 37.54 MB/s
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:05 devstack sudo[96117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363 1G
Nov 07 02:39:05 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:05 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363 1G" returned: 0 in 0.442s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Downloaded image e17a9067-5798-44ad-877c-38fbc4f9665f ((None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}])) to volume 6c843494-f39b-449a-9115-11ed39fc8363 successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Temporary image e17a9067-5798-44ad-877c-38fbc4f9665f for user cf75c517ef344018ab916ae4ff49f70e is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Marking volume 6c843494-f39b-449a-9115-11ed39fc8363 as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Copying metadata from image e17a9067-5798-44ad-877c-38fbc4f9665f to 6c843494-f39b-449a-9115-11ed39fc8363. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Creating volume glance metadata for volume 6c843494-f39b-449a-9115-11ed39fc8363 backed by image e17a9067-5798-44ad-877c-38fbc4f9665f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45458fc-89c2-4fed-ab9f-2d960f0289a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c843494-f39b-449a-9115-11ed39fc8363', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fbdd51c0>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffd373d-5fb6-47d4-9e24-62eaaf718d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:05 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Volume volume-6c843494-f39b-449a-9115-11ed39fc8363 (6c843494-f39b-449a-9115-11ed39fc8363): created successfully
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffd373d-5fb6-47d4-9e24-62eaaf718d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Flow 'volume_create_manager' (1e076411-2d87-479a-848d-73e84e501a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-218b6727-a821-4ad3-8a4f-d84d3ebfd123 tempest-TestShelveInstance-1196985998 None] Created volume successfully.
Nov 07 02:39:07 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Flow 'volume_create_manager' (a1993321-cd73-4074-ad20-abecd65c6579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b223b722-b45a-4b6c-8904-c0ca8c1f9600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b223b722-b45a-4b6c-8904-c0ca8c1f9600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1732217624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16092ac5-da30-491f-a9b0-315066242f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b372c6112384a7b8b103f2998b53c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:08Z,use_quota=True,user_id='03468e7635374428944d4ad755bdf882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6d1375-c0bd-42de-87c8-fe9695fb8250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6d1375-c0bd-42de-87c8-fe9695fb8250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b548edd2-42fb-411a-9310-f5810126518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b548edd2-42fb-411a-9310-f5810126518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16092ac5-da30-491f-a9b0-315066242f59', 'volume_name': 'volume-16092ac5-da30-491f-a9b0-315066242f59', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102a11f9-51e8-4009-9317-cc92159a5322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102a11f9-51e8-4009-9317-cc92159a5322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec1c72e-8a6d-4f6d-9ffe-7ad5123e6ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Volume 16092ac5-da30-491f-a9b0-315066242f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16092ac5-da30-491f-a9b0-315066242f59', 'volume_size': 1}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1732217624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16092ac5-da30-491f-a9b0-315066242f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b372c6112384a7b8b103f2998b53c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:08Z,use_quota=True,user_id='03468e7635374428944d4ad755bdf882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Creating volume 16092ac5-da30-491f-a9b0-315066242f59 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:08 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:08 devstack sudo[96130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59 1073741824
Nov 07 02:39:08 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:08 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59 1073741824" returned: 0 in 0.721s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=105,cinder:UPDATE=114,cinder:INSERT=45,cinder:DELETE=13 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:39:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:08 devstack sudo[96139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59
Nov 07 02:39:08 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Flow 'volume_create_manager' (66679651-2364-468e-9574-91b45347e598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c85521-0521-44c4-9605-9f9828a32d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c85521-0521-44c4-9605-9f9828a32d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1293789893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c1ddf0-2443-4363-9f84-d684cf4d3abe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15c165d77c6a49a3b6015fcb71bca615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:09Z,use_quota=True,user_id='1df8fe9f337042729c12059ccc1cf3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3630b915-5b59-49d3-bb05-155e798d6629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3630b915-5b59-49d3-bb05-155e798d6629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b50c06c-878a-4019-ac43-314f44d12c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b50c06c-878a-4019-ac43-314f44d12c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c1ddf0-2443-4363-9f84-d684cf4d3abe', 'volume_name': 'volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a30773-7daa-4032-9cde-eab7944a10be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a30773-7daa-4032-9cde-eab7944a10be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a19209-26bf-4877-ad0f-a70d8ac1a0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Volume 31c1ddf0-2443-4363-9f84-d684cf4d3abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe', 'volume_size': 1}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:09 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59" returned: 0 in 0.315s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.065s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1293789893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c1ddf0-2443-4363-9f84-d684cf4d3abe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15c165d77c6a49a3b6015fcb71bca615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:09Z,use_quota=True,user_id='1df8fe9f337042729c12059ccc1cf3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Creating volume 31c1ddf0-2443-4363-9f84-d684cf4d3abe {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:09 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=115,cinder:UPDATE=135,cinder:INSERT=48,cinder:DELETE=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec1c72e-8a6d-4f6d-9ffe-7ad5123e6ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16092ac5-da30-491f-a9b0-315066242f59', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13f8714-af9e-4c15-b66d-13a14d8768bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:09 devstack sudo[96143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe 1073741824
Nov 07 02:39:09 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Volume volume-16092ac5-da30-491f-a9b0-315066242f59 (16092ac5-da30-491f-a9b0-315066242f59): created successfully
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13f8714-af9e-4c15-b66d-13a14d8768bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Flow 'volume_create_manager' (a1993321-cd73-4074-ad20-abecd65c6579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-88de7de5-614a-4178-9621-2fd4f7146227 tempest-AttachVolumeTestJSON-1343838001 None] Created volume successfully.
Nov 07 02:39:09 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe 1073741824" returned: 0 in 0.720s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:09 devstack sudo[96150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe
Nov 07 02:39:09 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:10 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe" returned: 0 in 0.319s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a19209-26bf-4877-ad0f-a70d8ac1a0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7364e3d3-7223-4663-912a-57a6e522f831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:10 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Volume volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe (31c1ddf0-2443-4363-9f84-d684cf4d3abe): created successfully
Nov 07 02:39:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7364e3d3-7223-4663-912a-57a6e522f831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Flow 'volume_create_manager' (66679651-2364-468e-9574-91b45347e598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cb607c85-b8a4-4132-8c16-5d09549f00a8 tempest-VolumesListTestJSON-862063575 None] Created volume successfully.
Nov 07 02:39:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-5106e582-b036-4fde-bcd4-27e5a424f666 req-587d551d-cce4-4521-b318-b9a24ae89b7b tempest-TestShelveInstance-1196985998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-5106e582-b036-4fde-bcd4-27e5a424f666 req-587d551d-cce4-4521-b318-b9a24ae89b7b tempest-TestShelveInstance-1196985998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-5106e582-b036-4fde-bcd4-27e5a424f666 req-587d551d-cce4-4521-b318-b9a24ae89b7b tempest-TestShelveInstance-1196985998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-5106e582-b036-4fde-bcd4-27e5a424f666 req-587d551d-cce4-4521-b318-b9a24ae89b7b tempest-TestShelveInstance-1196985998 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-6c843494-f39b-449a-9115-11ed39fc8363', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32aad7c3-a06d-46b9-b8b3-e95859f10286', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:39:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-5106e582-b036-4fde-bcd4-27e5a424f666 req-587d551d-cce4-4521-b318-b9a24ae89b7b tempest-TestShelveInstance-1196985998 None] attachment_update completed successfully.
Nov 07 02:39:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-f2e3de9a-115d-4f40-b776-c1ca08d0b49a req-1996ce49-8a0e-4683-ba1e-1d49e4a2b4c6 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-f2e3de9a-115d-4f40-b776-c1ca08d0b49a req-1996ce49-8a0e-4683-ba1e-1d49e4a2b4c6 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-f2e3de9a-115d-4f40-b776-c1ca08d0b49a req-1996ce49-8a0e-4683-ba1e-1d49e4a2b4c6 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-f2e3de9a-115d-4f40-b776-c1ca08d0b49a req-1996ce49-8a0e-4683-ba1e-1d49e4a2b4c6 tempest-AttachVolumeTestJSON-1343838001 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-16092ac5-da30-491f-a9b0-315066242f59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bc21d89-7b7f-41fb-aac3-a84abb6f878f', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:39:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-f2e3de9a-115d-4f40-b776-c1ca08d0b49a req-1996ce49-8a0e-4683-ba1e-1d49e4a2b4c6 tempest-AttachVolumeTestJSON-1343838001 None] attachment_update completed successfully.
Nov 07 02:39:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Flow 'volume_create_manager' (ce33efe3-070c-4abc-b956-34ced6b67bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8552da-c55c-46fe-b466-14f097a55b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8552da-c55c-46fe-b466-14f097a55b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1063674231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378fab73-469b-498b-94f6-db3d4602fd5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15c165d77c6a49a3b6015fcb71bca615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:12Z,use_quota=True,user_id='1df8fe9f337042729c12059ccc1cf3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26480af3-8005-4ce9-b26c-6299605a3422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26480af3-8005-4ce9-b26c-6299605a3422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d240299b-1563-415d-a436-287c9f0caa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d240299b-1563-415d-a436-287c9f0caa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378fab73-469b-498b-94f6-db3d4602fd5c', 'volume_name': 'volume-378fab73-469b-498b-94f6-db3d4602fd5c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4ea362-f19f-4b4a-920e-b280b03380cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4ea362-f19f-4b4a-920e-b280b03380cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798c76bf-6259-4b4e-9b5a-2b3a6885ca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Volume 378fab73-469b-498b-94f6-db3d4602fd5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378fab73-469b-498b-94f6-db3d4602fd5c', 'volume_size': 1}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1063674231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378fab73-469b-498b-94f6-db3d4602fd5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15c165d77c6a49a3b6015fcb71bca615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:12Z,use_quota=True,user_id='1df8fe9f337042729c12059ccc1cf3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Creating volume 378fab73-469b-498b-94f6-db3d4602fd5c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:12 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:12 devstack sudo[96588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c 1073741824
Nov 07 02:39:12 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:12 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c 1073741824" returned: 0 in 0.761s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:12 devstack sudo[96597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c
Nov 07 02:39:12 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:13 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798c76bf-6259-4b4e-9b5a-2b3a6885ca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378fab73-469b-498b-94f6-db3d4602fd5c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e4f333-93eb-4ca4-b2f9-f8f22b993c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Volume volume-378fab73-469b-498b-94f6-db3d4602fd5c (378fab73-469b-498b-94f6-db3d4602fd5c): created successfully
Nov 07 02:39:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e4f333-93eb-4ca4-b2f9-f8f22b993c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Flow 'volume_create_manager' (ce33efe3-070c-4abc-b956-34ced6b67bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-565333b1-f5b3-4f2c-9933-146462f8e80f tempest-VolumesListTestJSON-862063575 None] Created volume successfully.
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Flow 'volume_create_manager' (cd63639c-c9d8-4434-966a-4691a84c52c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a0c3e8-3099-43b0-8172-0c707bb5a5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a0c3e8-3099-43b0-8172-0c707bb5a5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101886369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc58822-8d55-4c3c-bdef-d8e713b369c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15c165d77c6a49a3b6015fcb71bca615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:15Z,use_quota=True,user_id='1df8fe9f337042729c12059ccc1cf3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d98b48-ef99-496a-b694-830a0d551cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d98b48-ef99-496a-b694-830a0d551cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835b14b1-f068-4897-8c1d-dd977ef2b99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835b14b1-f068-4897-8c1d-dd977ef2b99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc58822-8d55-4c3c-bdef-d8e713b369c1', 'volume_name': 'volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b3a962-7d06-4b27-8bbf-d95e37f28b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b3a962-7d06-4b27-8bbf-d95e37f28b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a02344c-645d-4ec1-9b1c-0af2c72d3232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:15 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Volume bdc58822-8d55-4c3c-bdef-d8e713b369c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1', 'volume_size': 1}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101886369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc58822-8d55-4c3c-bdef-d8e713b369c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15c165d77c6a49a3b6015fcb71bca615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:15Z,use_quota=True,user_id='1df8fe9f337042729c12059ccc1cf3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Creating volume bdc58822-8d55-4c3c-bdef-d8e713b369c1 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:15 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:39:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:15 devstack sudo[96672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1 1073741824
Nov 07 02:39:15 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:16 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1 1073741824" returned: 0 in 0.866s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:16 devstack sudo[96680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1
Nov 07 02:39:16 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:16 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1" returned: 0 in 0.551s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a02344c-645d-4ec1-9b1c-0af2c72d3232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f2e181-3d3c-42f4-85f2-f75461a8219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Volume volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1 (bdc58822-8d55-4c3c-bdef-d8e713b369c1): created successfully
Nov 07 02:39:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f2e181-3d3c-42f4-85f2-f75461a8219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Flow 'volume_create_manager' (cd63639c-c9d8-4434-966a-4691a84c52c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-05a8e97f-e712-43ce-b45a-20cc1eb4d61d tempest-VolumesListTestJSON-862063575 None] Created volume successfully.
Nov 07 02:39:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Acquiring lock "cinder-bdc58822-8d55-4c3c-bdef-d8e713b369c1-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Lock "cinder-bdc58822-8d55-4c3c-bdef-d8e713b369c1-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Acquiring lock "cinder-quobyte-bdc58822-8d55-4c3c-bdef-d8e713b369c1" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Lock "cinder-quobyte-bdc58822-8d55-4c3c-bdef-d8e713b369c1" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1072ce9-180e-417f-8379-102605d8b328]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:23 devstack sudo[96788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1
Nov 07 02:39:23 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:23 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1" returned: 0 in 0.612s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:23 devstack sudo[96794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1
Nov 07 02:39:23 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:24 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-bdc58822-8d55-4c3c-bdef-d8e713b369c1" returned: 0 in 0.455s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Lock "cinder-quobyte-bdc58822-8d55-4c3c-bdef-d8e713b369c1" released by "delete_volume" :: held 1.148s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:24 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Created reservations ['b8b22f66-97fd-42b0-92ea-70e15797e6bd', '7e461fc6-7892-464b-bac4-7556406fdb6d', '38c8466d-b93a-4ae7-9e18-dd5c4e79aedf', '7f7694cd-0a9d-48a7-812d-9b551aa0864e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:24 devstack sudo[96797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:39:24 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:25 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.681s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:25 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Deleted volume successfully.
Nov 07 02:39:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ac717711-94ec-47e0-9785-7a1e7186303c tempest-VolumesListTestJSON-862063575 None] Lock "cinder-bdc58822-8d55-4c3c-bdef-d8e713b369c1-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Acquiring lock "cinder-378fab73-469b-498b-94f6-db3d4602fd5c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Lock "cinder-378fab73-469b-498b-94f6-db3d4602fd5c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Acquiring lock "cinder-quobyte-378fab73-469b-498b-94f6-db3d4602fd5c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Lock "cinder-quobyte-378fab73-469b-498b-94f6-db3d4602fd5c" acquired by "delete_volume" :: waited 0.051s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e96b27b-cbe0-41bd-adc0-1e60c67e3101]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:26 devstack sudo[96803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c
Nov 07 02:39:26 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:26 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c" returned: 0 in 0.612s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:26 devstack sudo[96808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c
Nov 07 02:39:26 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:26 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-378fab73-469b-498b-94f6-db3d4602fd5c" returned: 0 in 0.304s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Lock "cinder-quobyte-378fab73-469b-498b-94f6-db3d4602fd5c" released by "delete_volume" :: held 0.998s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:26 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Created reservations ['a24df531-9216-43f1-ab5b-c309e1b86540', '132940c1-01d5-4c08-9e62-ff96d4ab70da', '9306a997-580c-495c-95bc-3aa7143c14b5', '17ce4a3c-0178-4240-ae43-e965b46b1d90'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:26 devstack sudo[96811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:39:27 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:27 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.361s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Deleted volume successfully.
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1894088-6f48-4006-b915-8dce38506b4a tempest-VolumesListTestJSON-862063575 None] Lock "cinder-378fab73-469b-498b-94f6-db3d4602fd5c-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Flow 'volume_create_manager' (3f2ccc93-7f84-44ce-b34a-e7ecafb0f264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538068f6-15dc-47b7-85ae-a0f117a82ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538068f6-15dc-47b7-85ae-a0f117a82ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-608679004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21bc5ab-82c2-442a-b985-da61541fae41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d3c3c89de347b9952dcce960692fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:28Z,use_quota=True,user_id='7576f5e806434a16865684766255a6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e4ef5e1-f356-4691-8510-87556cd5f4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e4ef5e1-f356-4691-8510-87556cd5f4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e30de1-d6b0-4da9-bc31-e306bcbb52b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e30de1-d6b0-4da9-bc31-e306bcbb52b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21bc5ab-82c2-442a-b985-da61541fae41', 'volume_name': 'volume-b21bc5ab-82c2-442a-b985-da61541fae41', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e70aea-0c68-4649-80ca-3c1e4590de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e70aea-0c68-4649-80ca-3c1e4590de63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1519e8f3-b736-40b0-8f3e-eebc4730682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Volume b21bc5ab-82c2-442a-b985-da61541fae41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21bc5ab-82c2-442a-b985-da61541fae41', 'volume_size': 1}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-608679004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21bc5ab-82c2-442a-b985-da61541fae41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d3c3c89de347b9952dcce960692fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:28Z,use_quota=True,user_id='7576f5e806434a16865684766255a6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Creating volume b21bc5ab-82c2-442a-b985-da61541fae41 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:27 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:39:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:27 devstack sudo[96815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41 1073741824
Nov 07 02:39:27 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Acquiring lock "cinder-31c1ddf0-2443-4363-9f84-d684cf4d3abe-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Lock "cinder-31c1ddf0-2443-4363-9f84-d684cf4d3abe-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Acquiring lock "cinder-quobyte-31c1ddf0-2443-4363-9f84-d684cf4d3abe" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Lock "cinder-quobyte-31c1ddf0-2443-4363-9f84-d684cf4d3abe" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9bca7d-5e93-4853-918e-41330ba9bc02]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:28 devstack sudo[96817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe
Nov 07 02:39:28 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:28 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41 1073741824" returned: 0 in 0.566s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:28 devstack sudo[96826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41
Nov 07 02:39:28 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:28 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe" returned: 0 in 0.568s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:28 devstack sudo[96831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe
Nov 07 02:39:28 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:28 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41" returned: 0 in 0.388s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1519e8f3-b736-40b0-8f3e-eebc4730682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21bc5ab-82c2-442a-b985-da61541fae41', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971c79b7-caf1-4739-aab0-fbea9c5b104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Volume volume-b21bc5ab-82c2-442a-b985-da61541fae41 (b21bc5ab-82c2-442a-b985-da61541fae41): created successfully
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971c79b7-caf1-4739-aab0-fbea9c5b104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Flow 'volume_create_manager' (3f2ccc93-7f84-44ce-b34a-e7ecafb0f264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-67a085a2-e8f5-4a9d-a71e-6dc17af7320d tempest-VolumesMetadataTest-360054587 None] Created volume successfully.
Nov 07 02:39:29 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31c1ddf0-2443-4363-9f84-d684cf4d3abe" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Lock "cinder-quobyte-31c1ddf0-2443-4363-9f84-d684cf4d3abe" released by "delete_volume" :: held 0.952s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Created reservations ['1909e1b9-f7f1-416f-a19a-c94d981f71b5', '3472d8f2-3a85-447d-8457-91fe6187e63e', '62fe1571-544f-4e48-940b-cd2832b1b14b', 'b859c2b3-7563-4211-9513-41c8de405399'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:29 devstack sudo[96835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:39:29 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:29 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.263s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Deleted volume successfully.
Nov 07 02:39:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a1631326-5368-41d5-b066-997dc9facb9b tempest-VolumesListTestJSON-862063575 None] Lock "cinder-31c1ddf0-2443-4363-9f84-d684cf4d3abe-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Acquiring lock "cinder-b21bc5ab-82c2-442a-b985-da61541fae41-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Lock "cinder-b21bc5ab-82c2-442a-b985-da61541fae41-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Acquiring lock "cinder-quobyte-b21bc5ab-82c2-442a-b985-da61541fae41" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Lock "cinder-quobyte-b21bc5ab-82c2-442a-b985-da61541fae41" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de59d72-6db5-4bfe-b3d8-5f798c3fb682]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:31 devstack sudo[96838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41
Nov 07 02:39:31 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:31 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41" returned: 0 in 0.451s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:31 devstack sudo[96844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41
Nov 07 02:39:31 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:31 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b21bc5ab-82c2-442a-b985-da61541fae41" returned: 0 in 0.340s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Lock "cinder-quobyte-b21bc5ab-82c2-442a-b985-da61541fae41" released by "delete_volume" :: held 0.846s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:31 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Created reservations ['f2f61797-2ef5-4482-9819-51fc3c060644', '4950b3c1-9a74-4b11-9a7b-5b7db959bffb', '7c31bb88-6c03-4aa1-8d55-cd72e5bbb60f', 'e6d1eec4-cc55-409b-b837-0de13624ef9b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:32 devstack sudo[96905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:39:32 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:32 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.801s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:32 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Deleted volume successfully.
Nov 07 02:39:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-050ff0ac-cd9d-4dc4-b600-d9210bfc0a8b tempest-VolumesMetadataTest-360054587 None] Lock "cinder-b21bc5ab-82c2-442a-b985-da61541fae41-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:36 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Flow 'volume_create_manager' (e0f8b1a3-3160-43bb-8a71-49b8d83b1035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5c01ac-670c-41f5-97a9-b39a0a800573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5c01ac-670c-41f5-97a9-b39a0a800573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-742159290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73a5c30-6c92-4690-9353-4caeacaac46c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff370ef619c04b97977f3d7cb6e8722b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:37Z,use_quota=True,user_id='28df8d1cf58b44a4ad1684fe834f1fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15374228-161a-4729-96e3-abdfaf0fd6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15374228-161a-4729-96e3-abdfaf0fd6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c76de3-80d1-402d-8ed8-20458b0c29b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c76de3-80d1-402d-8ed8-20458b0c29b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a73a5c30-6c92-4690-9353-4caeacaac46c', 'volume_name': 'volume-a73a5c30-6c92-4690-9353-4caeacaac46c', 'volume_size': 2}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ca7249-73a1-491b-b42c-49711e5c9a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ca7249-73a1-491b-b42c-49711e5c9a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d1e0f1-e7ed-45a1-bc36-e2c87a6a3d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Volume a73a5c30-6c92-4690-9353-4caeacaac46c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a73a5c30-6c92-4690-9353-4caeacaac46c', 'volume_size': 2}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-742159290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73a5c30-6c92-4690-9353-4caeacaac46c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff370ef619c04b97977f3d7cb6e8722b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:37Z,use_quota=True,user_id='28df8d1cf58b44a4ad1684fe834f1fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Creating volume a73a5c30-6c92-4690-9353-4caeacaac46c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:37 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c 2147483648 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:37 devstack sudo[96927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c 2147483648
Nov 07 02:39:37 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:37 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c 2147483648" returned: 0 in 0.663s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:37 devstack sudo[96936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c
Nov 07 02:39:37 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:38 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d1e0f1-e7ed-45a1-bc36-e2c87a6a3d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a73a5c30-6c92-4690-9353-4caeacaac46c', 'volume_size': 2}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941f094e-b3fc-43dd-b9ff-c20a60b74a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Volume volume-a73a5c30-6c92-4690-9353-4caeacaac46c (a73a5c30-6c92-4690-9353-4caeacaac46c): created successfully
Nov 07 02:39:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941f094e-b3fc-43dd-b9ff-c20a60b74a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Flow 'volume_create_manager' (e0f8b1a3-3160-43bb-8a71-49b8d83b1035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b87b199c-24a6-4ca8-a628-2de4d224594c tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Created volume successfully.
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Flow 'volume_create_manager' (0f6689c2-6ef7-4e17-954b-50a6ac06f86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e6eb71-e3b0-49f0-912a-4c9fac4b46ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e6eb71-e3b0-49f0-912a-4c9fac4b46ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-437473508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ef5c70-6182-4e27-9f75-5daf9855a724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7b348b4cf347c481837416ded53802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:39Z,use_quota=True,user_id='e7ff8b80bf6540969ab9a3c96a725ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ed491c-4913-4e24-8248-517ecc69e55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ed491c-4913-4e24-8248-517ecc69e55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba925549-1958-4570-ba3e-cbe09ea62e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba925549-1958-4570-ba3e-cbe09ea62e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ef5c70-6182-4e27-9f75-5daf9855a724', 'volume_name': 'volume-39ef5c70-6182-4e27-9f75-5daf9855a724', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (037308a7-bb60-456b-b0c1-acb649c53c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (037308a7-bb60-456b-b0c1-acb649c53c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346426dc-35e8-432f-85f8-aa77671f9b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Volume 39ef5c70-6182-4e27-9f75-5daf9855a724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ef5c70-6182-4e27-9f75-5daf9855a724', 'volume_size': 1}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-437473508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ef5c70-6182-4e27-9f75-5daf9855a724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7b348b4cf347c481837416ded53802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:39Z,use_quota=True,user_id='e7ff8b80bf6540969ab9a3c96a725ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Creating volume 39ef5c70-6182-4e27-9f75-5daf9855a724 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:39 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:39 devstack sudo[96945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724 1073741824
Nov 07 02:39:39 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:39 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724 1073741824" returned: 0 in 0.423s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:39 devstack sudo[96950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724
Nov 07 02:39:39 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:39 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724" returned: 0 in 0.269s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.694s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346426dc-35e8-432f-85f8-aa77671f9b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ef5c70-6182-4e27-9f75-5daf9855a724', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f13b622-d1b5-44a5-aa6e-bf37904d49e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Creating offline snapshot 6c5633ba-89e4-49c5-b683-b130dee911cd of volume a73a5c30-6c92-4690-9353-4caeacaac46c {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:39:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Volume volume-39ef5c70-6182-4e27-9f75-5daf9855a724 (39ef5c70-6182-4e27-9f75-5daf9855a724): created successfully
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f13b622-d1b5-44a5-aa6e-bf37904d49e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Flow 'volume_create_manager' (0f6689c2-6ef7-4e17-954b-50a6ac06f86a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc3482a-75b5-4ef5-8d0a-d55e910019ff]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e29c38f1-9081-4eff-823c-b7d83f562584 tempest-VolumesTransfersTest-1720339215 None] Created volume successfully.
Nov 07 02:39:40 devstack sudo[96953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c
Nov 07 02:39:40 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:40 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c" returned: 0 in 0.404s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd 2G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:40 devstack sudo[96958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd 2G
Nov 07 02:39:40 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:40 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f9778249-e8db-4334-bcbf-f4e783fbb381 tempest-VolumesTransfersTest-1731431584 None] Transfer volume completed successfully.
Nov 07 02:39:40 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd 2G" returned: 0 in 0.445s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a73a5c30-6c92-4690-9353-4caeacaac46c -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:40 devstack sudo[96964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a73a5c30-6c92-4690-9353-4caeacaac46c -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd
Nov 07 02:39:40 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:41 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a73a5c30-6c92-4690-9353-4caeacaac46c -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd" returned: 0 in 0.310s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:41 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd is being set with open permissions: ugo+rw
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:41 devstack sudo[96969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd
Nov 07 02:39:41 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Acquiring lock "cinder-39ef5c70-6182-4e27-9f75-5daf9855a724-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Lock "cinder-39ef5c70-6182-4e27-9f75-5daf9855a724-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Acquiring lock "cinder-quobyte-39ef5c70-6182-4e27-9f75-5daf9855a724" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:41 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd" returned: 0 in 0.290s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Lock "cinder-quobyte-39ef5c70-6182-4e27-9f75-5daf9855a724" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3055dd95-3ccf-4173-b7e5-8012c39bc07d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:41 devstack sudo[96973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.info
Nov 07 02:39:41 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:41 devstack sudo[96972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724
Nov 07 02:39:41 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:41 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.info" returned: 0 in 0.264s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:41 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.info is being set with open permissions: ugo+rw
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:41 devstack sudo[96977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.info
Nov 07 02:39:41 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:41 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724" returned: 0 in 0.383s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:41 devstack sudo[96982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724
Nov 07 02:39:41 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:42 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.info" returned: 0 in 0.266s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8cbe3439-33c2-4ee1-b21e-71313915d113 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Create snapshot completed successfully
Nov 07 02:39:42 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-39ef5c70-6182-4e27-9f75-5daf9855a724" returned: 0 in 0.256s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Lock "cinder-quobyte-39ef5c70-6182-4e27-9f75-5daf9855a724" released by "delete_volume" :: held 0.682s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Created reservations ['9bde9841-6649-495e-9308-2eb6b4346210', '45cf7b40-30f6-4877-8f8e-4b1ea74da6a5', '7489d606-ecb2-44d5-8d5e-3fee62f17e3c', '33449288-2a67-4dac-9ddd-4f4acb4af360'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:42 devstack sudo[96986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:39:42 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Acquiring lock "cinder-6c5633ba-89e4-49c5-b683-b130dee911cd-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "cinder-6c5633ba-89e4-49c5-b683-b130dee911cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Acquiring lock "cinder-quobyte-a73a5c30-6c92-4690-9353-4caeacaac46c" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "cinder-quobyte-a73a5c30-6c92-4690-9353-4caeacaac46c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Acquiring lock "cinder-quobyte-6c5633ba-89e4-49c5-b683-b130dee911cd" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "cinder-quobyte-6c5633ba-89e4-49c5-b683-b130dee911cd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Deleting offline snapshot 6c5633ba-89e4-49c5-b683-b130dee911cd of volume a73a5c30-6c92-4690-9353-4caeacaac46c {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:39:42 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] snapshot_file for this snap is: volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Deleted volume successfully.
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0df9c49-11ac-49c1-b181-f8f6758b6941]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c70a3779-95b0-47f4-ab38-1aa1e6818478 tempest-VolumesTransfersTest-1316959831 None] Lock "cinder-39ef5c70-6182-4e27-9f75-5daf9855a724-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:42 devstack sudo[96989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd
Nov 07 02:39:42 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:43 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd" returned: 0 in 0.441s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a73a5c30-6c92-4690-9353-4caeacaac46c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d528fcbb-b256-46bc-8a77-aae08fd65e2c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Flow 'volume_create_manager' (383e977f-29e9-4857-a929-c06a5d5bee8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:43 devstack sudo[96994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c
Nov 07 02:39:43 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a2984c-1d12-48eb-9cbf-b9acc585de49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a2984c-1d12-48eb-9cbf-b9acc585de49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-193578210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74390d0b-e7f2-4067-849e-3eb20d22cf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7b348b4cf347c481837416ded53802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:43Z,use_quota=True,user_id='e7ff8b80bf6540969ab9a3c96a725ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f3c1c4-0bce-4093-a4aa-1bd28df64dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f3c1c4-0bce-4093-a4aa-1bd28df64dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27fb34d8-3fd8-483a-b1dd-a6e0eb9654bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27fb34d8-3fd8-483a-b1dd-a6e0eb9654bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74390d0b-e7f2-4067-849e-3eb20d22cf16', 'volume_name': 'volume-74390d0b-e7f2-4067-849e-3eb20d22cf16', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7611b9a3-dcb3-40fe-b10d-a43a75b02ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7611b9a3-dcb3-40fe-b10d-a43a75b02ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2b1ab2-ba97-4df8-8807-f491de898670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:43 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Volume 74390d0b-e7f2-4067-849e-3eb20d22cf16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74390d0b-e7f2-4067-849e-3eb20d22cf16', 'volume_size': 1}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-193578210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74390d0b-e7f2-4067-849e-3eb20d22cf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7b348b4cf347c481837416ded53802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:43Z,use_quota=True,user_id='e7ff8b80bf6540969ab9a3c96a725ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Creating volume 74390d0b-e7f2-4067-849e-3eb20d22cf16 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:43 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:43 devstack sudo[96996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16 1073741824
Nov 07 02:39:43 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:43 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:43 devstack sudo[97001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd
Nov 07 02:39:43 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:43 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16 1073741824" returned: 0 in 0.532s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:43 devstack sudo[97010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16
Nov 07 02:39:43 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:43 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:43 devstack sudo[97012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd
Nov 07 02:39:43 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:44 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16" returned: 0 in 0.297s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2b1ab2-ba97-4df8-8807-f491de898670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74390d0b-e7f2-4067-849e-3eb20d22cf16', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313e6677-703e-4afa-a5ff-e72dd7b86692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:44 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Volume volume-74390d0b-e7f2-4067-849e-3eb20d22cf16 (74390d0b-e7f2-4067-849e-3eb20d22cf16): created successfully
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313e6677-703e-4afa-a5ff-e72dd7b86692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Flow 'volume_create_manager' (383e977f-29e9-4857-a929-c06a5d5bee8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:44 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c.6c5633ba-89e4-49c5-b683-b130dee911cd" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-38a89e88-c4ec-4eb5-bf4b-a52e72a21dea tempest-VolumesTransfersTest-1720339215 None] Created volume successfully.
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "cinder-quobyte-6c5633ba-89e4-49c5-b683-b130dee911cd" released by "_delete_snapshot" :: held 1.730s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "cinder-quobyte-a73a5c30-6c92-4690-9353-4caeacaac46c" released by "delete_snapshot" :: held 1.765s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Created reservations ['a0d6bcbb-23d5-4d36-977e-9de58835f678', 'd2110371-261f-4dd9-98e4-9da062563bd9', '4bdccf83-1bec-4051-8898-507d31840d92', '01299a9d-ca3b-4092-916d-859e95e28e6c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Delete snapshot completed successfully.
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d77ed6ca-400c-4524-9adc-9abb3946f415 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "cinder-6c5633ba-89e4-49c5-b683-b130dee911cd-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Acquiring lock "cinder-a73a5c30-6c92-4690-9353-4caeacaac46c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "cinder-a73a5c30-6c92-4690-9353-4caeacaac46c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Acquiring lock "cinder-quobyte-a73a5c30-6c92-4690-9353-4caeacaac46c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "cinder-quobyte-a73a5c30-6c92-4690-9353-4caeacaac46c" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe73595-3450-4c62-ae4d-b12bba89f439]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:45 devstack sudo[97016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c
Nov 07 02:39:45 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:45 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c" returned: 0 in 0.478s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:45 devstack sudo[97029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c
Nov 07 02:39:45 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Acquiring lock "cinder-74390d0b-e7f2-4067-849e-3eb20d22cf16-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Lock "cinder-74390d0b-e7f2-4067-849e-3eb20d22cf16-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:45 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a73a5c30-6c92-4690-9353-4caeacaac46c" returned: 0 in 0.380s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "cinder-quobyte-a73a5c30-6c92-4690-9353-4caeacaac46c" released by "delete_volume" :: held 0.972s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Acquiring lock "cinder-quobyte-74390d0b-e7f2-4067-849e-3eb20d22cf16" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Lock "cinder-quobyte-74390d0b-e7f2-4067-849e-3eb20d22cf16" acquired by "delete_volume" :: waited 0.045s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e131b920-9d23-4dff-8f7a-73c4d1fb63fe]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Created reservations ['f73f055a-8833-402e-b165-3772085f455a', '261d6068-5292-4d19-993a-288e37eb4427', 'c252a5e0-6495-45f8-9ace-1c12cda7ae3d', '1e91e4db-8976-45c5-b2a6-6282bcd7caf5'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:46 devstack sudo[97042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16
Nov 07 02:39:46 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:46 devstack sudo[97044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:39:46 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:46 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Deleted volume successfully.
Nov 07 02:39:46 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-87753c8a-f39f-436e-b201-08281bde22e6 tempest-VolumesSnapshotNegativeTestJSON-689780268 None] Lock "cinder-a73a5c30-6c92-4690-9353-4caeacaac46c-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16" returned: 0 in 0.666s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:46 devstack sudo[97054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16
Nov 07 02:39:46 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-34406a73-4a8f-4f93-8fc1-6e4400d9008e req-f3e4ffad-65d4-4ea1-8c51-e5fe6fc07802 tempest-AttachVolumeTestJSON-1343838001 None] Terminate volume connection completed successfully.
Nov 07 02:39:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-34406a73-4a8f-4f93-8fc1-6e4400d9008e req-f3e4ffad-65d4-4ea1-8c51-e5fe6fc07802 tempest-AttachVolumeTestJSON-1343838001 None] Deleting attachment 8bc21d89-7b7f-41fb-aac3-a84abb6f878f. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:39:47 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-74390d0b-e7f2-4067-849e-3eb20d22cf16" returned: 0 in 0.304s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Lock "cinder-quobyte-74390d0b-e7f2-4067-849e-3eb20d22cf16" released by "delete_volume" :: held 1.067s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Created reservations ['da889e42-8b7c-4d5f-885f-18c9d8208574', '10fab962-11d2-4a16-8e5b-cfb49ca33884', 'f80b3f40-f23f-4516-9ce8-00b32d41feb8', '44d90a1d-f851-45fb-9d5a-2dae7d24e03e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:47 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:39:47 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:47 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.271s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Deleted volume successfully.
Nov 07 02:39:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7c6b7d3b-6591-4258-b1c4-38fe971cc385 tempest-VolumesTransfersTest-1316959831 None] Lock "cinder-74390d0b-e7f2-4067-849e-3eb20d22cf16-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-d1cbc683-7046-4d7f-82cf-1ba215d0cb4a req-d6b55aa6-31a0-4f51-b311-db095d252d85 tempest-TestShelveInstance-1196985998 None] Terminate volume connection completed successfully.
Nov 07 02:39:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-d1cbc683-7046-4d7f-82cf-1ba215d0cb4a req-d6b55aa6-31a0-4f51-b311-db095d252d85 tempest-TestShelveInstance-1196985998 None] Deleting attachment 32aad7c3-a06d-46b9-b8b3-e95859f10286. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:39:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-00a2bf19-de49-49cd-8c83-9ebcf33ebe23 req-c2999d9f-9e61-4c8f-ad84-995d4a32f5dc tempest-TestShelveInstance-1196985998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-00a2bf19-de49-49cd-8c83-9ebcf33ebe23 req-c2999d9f-9e61-4c8f-ad84-995d4a32f5dc tempest-TestShelveInstance-1196985998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-00a2bf19-de49-49cd-8c83-9ebcf33ebe23 req-c2999d9f-9e61-4c8f-ad84-995d4a32f5dc tempest-TestShelveInstance-1196985998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-00a2bf19-de49-49cd-8c83-9ebcf33ebe23 req-c2999d9f-9e61-4c8f-ad84-995d4a32f5dc tempest-TestShelveInstance-1196985998 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-6c843494-f39b-449a-9115-11ed39fc8363', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fba908b0-63fc-4e92-8949-f56a049a202d', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:39:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-00a2bf19-de49-49cd-8c83-9ebcf33ebe23 req-c2999d9f-9e61-4c8f-ad84-995d4a32f5dc tempest-TestShelveInstance-1196985998 None] attachment_update completed successfully.
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:53 devstack sudo[97104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:39:53 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.558s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:53 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:39:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:40:02 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=71,cinder:INSERT=21,cinder:UPDATE=93,cinder:DELETE=8 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:40:02 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=86,cinder:SELECT=88,cinder:DELETE=8,cinder:INSERT=19 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Flow 'volume_create_manager' (7f60036b-c2a5-49fb-8a32-1b5228afca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6a8894-e729-4cc6-bb6d-9a9d4b35a631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6a8894-e729-4cc6-bb6d-9a9d4b35a631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-645959224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0043993-1bca-4f78-bb80-4c7e28383507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d050f0f87ad435b94ec2b348534eea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:12Z,use_quota=True,user_id='6e43e418041246ee98f08e1321426c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c856c7c-5c18-40d1-a1ee-e8c6c96e863a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c856c7c-5c18-40d1-a1ee-e8c6c96e863a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4208c485-3893-4fba-8c00-7aaeb20057f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4208c485-3893-4fba-8c00-7aaeb20057f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0043993-1bca-4f78-bb80-4c7e28383507', 'volume_name': 'volume-e0043993-1bca-4f78-bb80-4c7e28383507', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059b086d-8e51-4deb-a17b-42ea73f73815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059b086d-8e51-4deb-a17b-42ea73f73815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e634510-ad96-47dc-92ae-001f6e1713d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Volume e0043993-1bca-4f78-bb80-4c7e28383507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0043993-1bca-4f78-bb80-4c7e28383507', 'volume_size': 1}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-645959224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0043993-1bca-4f78-bb80-4c7e28383507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d050f0f87ad435b94ec2b348534eea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:12Z,use_quota=True,user_id='6e43e418041246ee98f08e1321426c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Creating volume e0043993-1bca-4f78-bb80-4c7e28383507 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:11 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:40:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:11 devstack sudo[97706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 1073741824
Nov 07 02:40:11 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:12 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 1073741824" returned: 0 in 0.744s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:12 devstack sudo[97713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507
Nov 07 02:40:12 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:12 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e634510-ad96-47dc-92ae-001f6e1713d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0043993-1bca-4f78-bb80-4c7e28383507', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6608f90-dd92-4d34-8c65-7e62e1cdcd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Volume volume-e0043993-1bca-4f78-bb80-4c7e28383507 (e0043993-1bca-4f78-bb80-4c7e28383507): created successfully
Nov 07 02:40:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6608f90-dd92-4d34-8c65-7e62e1cdcd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Flow 'volume_create_manager' (7f60036b-c2a5-49fb-8a32-1b5228afca9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fcb24542-345f-41b9-9b76-4203eedd5d00 tempest-VolumesActionsTest-928946301 None] Created volume successfully.
Nov 07 02:40:23 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:40:23 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:40:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f20c928c-78a5-458f-a9f7-379225e68ab9 tempest-VolumesActionsTest-928946301 None] Acquiring lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507" by "attach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f20c928c-78a5-458f-a9f7-379225e68ab9 tempest-VolumesActionsTest-928946301 None] Lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507" acquired by "attach_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f20c928c-78a5-458f-a9f7-379225e68ab9 tempest-VolumesActionsTest-928946301 None] Attaching volume e0043993-1bca-4f78-bb80-4c7e28383507 to instance 6d1518dc-81ea-4464-b917-15fdbe4ad0de at mountpoint /dev/vdb on host None.
Nov 07 02:40:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f20c928c-78a5-458f-a9f7-379225e68ab9 tempest-VolumesActionsTest-928946301 None] Attach volume completed successfully.
Nov 07 02:40:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-f20c928c-78a5-458f-a9f7-379225e68ab9 tempest-VolumesActionsTest-928946301 None] Lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507" released by "attach_volume" :: held 0.110s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1dd89b68-5d3e-4eba-81df-f5d52648683c tempest-VolumesActionsTest-928946301 None] Acquiring lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507-detach_volume" by "detach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1dd89b68-5d3e-4eba-81df-f5d52648683c tempest-VolumesActionsTest-928946301 None] Lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1dd89b68-5d3e-4eba-81df-f5d52648683c tempest-VolumesActionsTest-928946301 None] Detaching volume e0043993-1bca-4f78-bb80-4c7e28383507 from instance 6d1518dc-81ea-4464-b917-15fdbe4ad0de.
Nov 07 02:40:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1dd89b68-5d3e-4eba-81df-f5d52648683c tempest-VolumesActionsTest-928946301 None] Detach volume completed successfully.
Nov 07 02:40:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1dd89b68-5d3e-4eba-81df-f5d52648683c tempest-VolumesActionsTest-928946301 None] Lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:46 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:INSERT=1,cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:40:46 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:40:46 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Flow 'volume_create_manager' (e7798f96-4a98-458a-a04d-c654d6f58246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1b3b6a-de60-4d0d-91f2-54a5379fa918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1b3b6a-de60-4d0d-91f2-54a5379fa918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-395548865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c92a0d-966e-4a4d-933d-c77b1f0f9272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433bfccbdabb420095912e52e1eb24dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:47Z,use_quota=True,user_id='3b9b3b1500124115b2d52733892d2347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2a03f8-d40f-4807-bc8f-5a76c93ddad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2a03f8-d40f-4807-bc8f-5a76c93ddad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a71cf2d-ca42-4cc1-bef7-d517b443ed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a71cf2d-ca42-4cc1-bef7-d517b443ed50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96c92a0d-966e-4a4d-933d-c77b1f0f9272', 'volume_name': 'volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ca759e-cce1-432e-bd06-940cd446b8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ca759e-cce1-432e-bd06-940cd446b8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9107cfd9-388a-4fab-b519-fd884ce32ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:47 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Volume 96c92a0d-966e-4a4d-933d-c77b1f0f9272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272', 'volume_size': 1}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-395548865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c92a0d-966e-4a4d-933d-c77b1f0f9272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433bfccbdabb420095912e52e1eb24dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:47Z,use_quota=True,user_id='3b9b3b1500124115b2d52733892d2347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Creating volume 96c92a0d-966e-4a4d-933d-c77b1f0f9272 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:47 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:47 devstack sudo[98226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272 1073741824
Nov 07 02:40:47 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:47 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272 1073741824" returned: 0 in 0.888s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:48 devstack sudo[98235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272
Nov 07 02:40:48 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c391fe62-ae4b-42fa-a8b4-21be3bb24fd5 tempest-VolumesActionsTest-928946301 None] Acquiring lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507" by "attach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c391fe62-ae4b-42fa-a8b4-21be3bb24fd5 tempest-VolumesActionsTest-928946301 None] Lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507" acquired by "attach_volume" :: waited 0.043s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c391fe62-ae4b-42fa-a8b4-21be3bb24fd5 tempest-VolumesActionsTest-928946301 None] Attaching volume e0043993-1bca-4f78-bb80-4c7e28383507 to instance 2b817aa1-a5cc-4621-8d2d-18d18bcd1fc1 at mountpoint /dev/vdb on host None.
Nov 07 02:40:48 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272" returned: 0 in 0.682s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c391fe62-ae4b-42fa-a8b4-21be3bb24fd5 tempest-VolumesActionsTest-928946301 None] Attach volume completed successfully.
Nov 07 02:40:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9107cfd9-388a-4fab-b519-fd884ce32ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80854e0a-31a7-418d-8ce5-4b1b9ec2c18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c391fe62-ae4b-42fa-a8b4-21be3bb24fd5 tempest-VolumesActionsTest-928946301 None] Lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507" released by "attach_volume" :: held 0.338s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:48 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Volume volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272 (96c92a0d-966e-4a4d-933d-c77b1f0f9272): created successfully
Nov 07 02:40:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80854e0a-31a7-418d-8ce5-4b1b9ec2c18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Flow 'volume_create_manager' (e7798f96-4a98-458a-a04d-c654d6f58246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-062aa20e-dba9-4016-b538-0acd46940d27 tempest-TestMinimumBasicScenario-54896219 None] Created volume successfully.
Nov 07 02:40:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99eada6b-5f05-416f-91e9-200842f46939 tempest-VolumesActionsTest-928946301 None] Acquiring lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507-detach_volume" by "detach_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99eada6b-5f05-416f-91e9-200842f46939 tempest-VolumesActionsTest-928946301 None] Lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-99eada6b-5f05-416f-91e9-200842f46939 tempest-VolumesActionsTest-928946301 None] Detaching volume e0043993-1bca-4f78-bb80-4c7e28383507 from instance 2b817aa1-a5cc-4621-8d2d-18d18bcd1fc1.
Nov 07 02:40:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-99eada6b-5f05-416f-91e9-200842f46939 tempest-VolumesActionsTest-928946301 None] Detach volume completed successfully.
Nov 07 02:40:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-99eada6b-5f05-416f-91e9-200842f46939 tempest-VolumesActionsTest-928946301 None] Lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507-detach_volume" released by "detach_volume" :: held 0.264s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-85564a4a-c6f2-49cd-b8c0-c0f41625fa3c req-aaa590e4-c6a2-47d5-b67e-278aea2b2cf6 tempest-TestMinimumBasicScenario-54896219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-85564a4a-c6f2-49cd-b8c0-c0f41625fa3c req-aaa590e4-c6a2-47d5-b67e-278aea2b2cf6 tempest-TestMinimumBasicScenario-54896219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-85564a4a-c6f2-49cd-b8c0-c0f41625fa3c req-aaa590e4-c6a2-47d5-b67e-278aea2b2cf6 tempest-TestMinimumBasicScenario-54896219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-85564a4a-c6f2-49cd-b8c0-c0f41625fa3c req-aaa590e4-c6a2-47d5-b67e-278aea2b2cf6 tempest-TestMinimumBasicScenario-54896219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e733ed3-94a4-481a-8e75-5e4251407c46', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:40:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-85564a4a-c6f2-49cd-b8c0-c0f41625fa3c req-aaa590e4-c6a2-47d5-b67e-278aea2b2cf6 tempest-TestMinimumBasicScenario-54896219 None] attachment_update completed successfully.
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:53 devstack sudo[98299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:40:53 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:53 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.578s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:40:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:40:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-7104d1dc-dd30-4930-a05e-069d834c748d tempest-TestShelveInstance-1196985998 None] Terminate volume connection completed successfully.
Nov 07 02:40:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-7104d1dc-dd30-4930-a05e-069d834c748d tempest-TestShelveInstance-1196985998 None] Deleting attachment fba908b0-63fc-4e92-8949-f56a049a202d. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:40:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Acquiring lock "cinder-6c843494-f39b-449a-9115-11ed39fc8363-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Lock "cinder-6c843494-f39b-449a-9115-11ed39fc8363-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Acquiring lock "cinder-quobyte-6c843494-f39b-449a-9115-11ed39fc8363" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Lock "cinder-quobyte-6c843494-f39b-449a-9115-11ed39fc8363" acquired by "delete_volume" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3333c52-acd0-4e48-a7b7-8e37c1b8f89d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:56 devstack sudo[98328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363
Nov 07 02:40:56 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:56 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363" returned: 0 in 0.619s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:56 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363
Nov 07 02:40:56 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:57 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6c843494-f39b-449a-9115-11ed39fc8363" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Lock "cinder-quobyte-6c843494-f39b-449a-9115-11ed39fc8363" released by "delete_volume" :: held 1.025s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG cinder.quota [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Created reservations ['8358675b-5697-4306-b6b2-5311a3d0e8ed', '83ef6bff-2b68-4957-b90f-ad15d5361664', '5382df60-5a10-4b73-959d-dac5e75e6617', '39c5863d-3cfb-44e4-97d2-a62ac08780c5'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:57 devstack sudo[98338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:40:57 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:57 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.482s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG cinder.manager [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Deleted volume successfully.
Nov 07 02:40:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [req-b84efaf0-aa25-4d7f-93a7-f4b1f0122891 req-642b7bee-6aff-4950-9a93-808c3afc2ca9 tempest-TestShelveInstance-1196985998 None] Lock "cinder-6c843494-f39b-449a-9115-11ed39fc8363-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeda6e1-599d-469c-b6d0-95b833669c5c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:59 devstack sudo[98343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507
Nov 07 02:40:59 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:00 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507" returned: 0 in 0.462s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[89923038-ec1d-4e81-988f-346c78f55992]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:00 devstack sudo[98349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507
Nov 07 02:41:00 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:00 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507" returned: 0 in 0.451s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.b7a531f1-6fbe-419a-b670-9cd95947225dog_bl5ft.img {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:00 devstack sudo[98355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.b7a531f1-6fbe-419a-b670-9cd95947225dog_bl5ft.img
Nov 07 02:41:00 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:07 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=24,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:41:09 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=14,cinder:SELECT=19,cinder:INSERT=5 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:41:09 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.b7a531f1-6fbe-419a-b670-9cd95947225dog_bl5ft.img" returned: 0 in 9.424s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed70f6c-80fa-4c9e-9041-092172f5c404]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:10 devstack sudo[98397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507
Nov 07 02:41:10 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:10 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507" returned: 0 in 0.643s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:10 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507, size 1024.00 MB, duration 9.43 sec, destination /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.b7a531f1-6fbe-419a-b670-9cd95947225dog_bl5ft.img {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:41:10 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] Converted 1024.00 MB image at 108.64 MB/s
Nov 07 02:41:10 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] b7a531f1-6fbe-419a-b670-9cd95947225d was raw, no need to convert to raw {{(pid=87087) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Flow 'volume_create_manager' (cbc6623e-2c63-4393-b9ef-23d6d1e0e551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f32f3b7-90f9-4f21-8a9b-c19bf19bd18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f32f3b7-90f9-4f21-8a9b-c19bf19bd18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1362103576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e10e7b-8ebf-4625-ba05-c33a8cc1c974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b372c6112384a7b8b103f2998b53c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:16Z,use_quota=True,user_id='03468e7635374428944d4ad755bdf882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57135c23-3bdd-4905-a071-6a46c288cbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57135c23-3bdd-4905-a071-6a46c288cbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc25a58-0e90-40a8-9aba-cb2dfc139438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc25a58-0e90-40a8-9aba-cb2dfc139438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e10e7b-8ebf-4625-ba05-c33a8cc1c974', 'volume_name': 'volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c542c39b-8205-48b5-b97b-c68c5519f85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c542c39b-8205-48b5-b97b-c68c5519f85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d5dc08-634d-4b38-8936-088333be0d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Volume 90e10e7b-8ebf-4625-ba05-c33a8cc1c974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974', 'volume_size': 1}
Nov 07 02:41:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Flow 'volume_create_manager' (78ae4ce9-4da7-4b40-aac0-5c7558c27d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796f9b30-0615-4c28-98fe-c86e485f9d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796f9b30-0615-4c28-98fe-c86e485f9d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-19913291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a995d2a3-279f-4142-b99a-de65e8640e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78d53184e824399814cbfcd01b93e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:19Z,use_quota=True,user_id='31ad231f1cee4d4d904ca71882528eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5206f9f-6df9-4164-b950-542cb4554336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5206f9f-6df9-4164-b950-542cb4554336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccb2e3b-1370-47fa-82b0-fa506ffa4390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccb2e3b-1370-47fa-82b0-fa506ffa4390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a995d2a3-279f-4142-b99a-de65e8640e01', 'volume_name': 'volume-a995d2a3-279f-4142-b99a-de65e8640e01', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8403791e-3e0e-49e5-ab9e-39d8449bad1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8403791e-3e0e-49e5-ab9e-39d8449bad1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b35927-e4d7-4934-8c52-1a8017a80b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:18 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Volume a995d2a3-279f-4142-b99a-de65e8640e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a995d2a3-279f-4142-b99a-de65e8640e01', 'volume_size': 1}
Nov 07 02:41:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Flow 'volume_create_manager' (d6f3f99d-8508-4941-bf15-c2581f187d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19563c6d-bb31-43d2-81c3-efd007ea902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19563c6d-bb31-43d2-81c3-efd007ea902e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-371135547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b32a13-4ebe-48ce-90c6-948d36f72edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78d53184e824399814cbfcd01b93e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:19Z,use_quota=True,user_id='31ad231f1cee4d4d904ca71882528eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39f4664-76e2-4c9c-b229-e7b215d4e02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39f4664-76e2-4c9c-b229-e7b215d4e02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45b92d5-3327-4b96-b71c-0a79bbbbf382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45b92d5-3327-4b96-b71c-0a79bbbbf382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b32a13-4ebe-48ce-90c6-948d36f72edb', 'volume_name': 'volume-08b32a13-4ebe-48ce-90c6-948d36f72edb', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5b74e7-ad6b-4408-8b89-ac43896c7a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5b74e7-ad6b-4408-8b89-ac43896c7a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70bbfad-8da7-4cde-b60e-4055f1b3ccc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Volume 08b32a13-4ebe-48ce-90c6-948d36f72edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b32a13-4ebe-48ce-90c6-948d36f72edb', 'volume_size': 1}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Flow 'volume_create_manager' (8a2924bf-198c-4656-aaf3-195ff39bfee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3959452-2ff0-4ac1-a519-169427f7080f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3959452-2ff0-4ac1-a519-169427f7080f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1792100204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb981203-58a5-4bc4-9f43-2ec15895815e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78d53184e824399814cbfcd01b93e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:20Z,use_quota=True,user_id='31ad231f1cee4d4d904ca71882528eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d35d8b-b5d3-4ece-8059-5252216dc507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d35d8b-b5d3-4ece-8059-5252216dc507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b80e278-2541-4544-a23f-94802de12541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b80e278-2541-4544-a23f-94802de12541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb981203-58a5-4bc4-9f43-2ec15895815e', 'volume_name': 'volume-fb981203-58a5-4bc4-9f43-2ec15895815e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f12da61-eda5-4895-a6c6-cac70e92a616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f12da61-eda5-4895-a6c6-cac70e92a616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04ffd85-a483-41cd-9729-924d8359a4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Volume fb981203-58a5-4bc4-9f43-2ec15895815e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb981203-58a5-4bc4-9f43-2ec15895815e', 'volume_size': 1}
Nov 07 02:41:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Flow 'volume_create_manager' (1256f955-d880-45c1-9301-574229676105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f72e4e1-7d46-4161-9b69-a0ab7d3af018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f72e4e1-7d46-4161-9b69-a0ab7d3af018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-670323830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada747c6-3414-4309-8d14-064d30d45fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78d53184e824399814cbfcd01b93e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:20Z,use_quota=True,user_id='31ad231f1cee4d4d904ca71882528eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be80e9fb-cc44-43fd-a585-e4a445e94a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be80e9fb-cc44-43fd-a585-e4a445e94a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55151c91-4c7b-4b07-9c62-f4ee016b3a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55151c91-4c7b-4b07-9c62-f4ee016b3a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada747c6-3414-4309-8d14-064d30d45fae', 'volume_name': 'volume-ada747c6-3414-4309-8d14-064d30d45fae', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368e3afb-45f5-4109-a21a-e28097b6620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368e3afb-45f5-4109-a21a-e28097b6620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934a1d04-56df-4b43-a0f2-26c022a5569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Volume ada747c6-3414-4309-8d14-064d30d45fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada747c6-3414-4309-8d14-064d30d45fae', 'volume_size': 1}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Flow 'volume_create_manager' (a8c5b1f3-c5be-449c-a3b0-4c03df385f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2a0670-47b1-4e9e-ad21-f5b341497764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2a0670-47b1-4e9e-ad21-f5b341497764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1710535885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117e3df7-dcea-4aca-8f5a-5c58815d3722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78d53184e824399814cbfcd01b93e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:20Z,use_quota=True,user_id='31ad231f1cee4d4d904ca71882528eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05bd527-3d27-43e2-8e19-632db445672a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05bd527-3d27-43e2-8e19-632db445672a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3d1891-41e7-43cc-929c-73569d35f1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3d1891-41e7-43cc-929c-73569d35f1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117e3df7-dcea-4aca-8f5a-5c58815d3722', 'volume_name': 'volume-117e3df7-dcea-4aca-8f5a-5c58815d3722', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8b13b9-ce60-4c29-b88a-90628b479824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8b13b9-ce60-4c29-b88a-90628b479824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd87d40-cc67-4269-93e6-81a5785c2b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Volume 117e3df7-dcea-4aca-8f5a-5c58815d3722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117e3df7-dcea-4aca-8f5a-5c58815d3722', 'volume_size': 1}
Nov 07 02:41:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:30 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:41:30 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.829s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] Uploaded volume to glance image-id: b7a531f1-6fbe-419a-b670-9cd95947225d. {{(pid=87087) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.204s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1362103576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e10e7b-8ebf-4625-ba05-c33a8cc1c974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b372c6112384a7b8b103f2998b53c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:16Z,use_quota=True,user_id='03468e7635374428944d4ad755bdf882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Creating volume 90e10e7b-8ebf-4625-ba05-c33a8cc1c974 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:32 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:32 devstack sudo[98445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974 1073741824
Nov 07 02:41:32 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-489883d2-f23e-4754-81a7-f4f9991996f0 tempest-VolumesActionsTest-928946301 None] Copy volume to image completed successfully.
Nov 07 02:41:32 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974 1073741824" returned: 0 in 0.457s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:32 devstack sudo[98450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974
Nov 07 02:41:32 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:33 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974" returned: 0 in 0.258s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.249s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-19913291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a995d2a3-279f-4142-b99a-de65e8640e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78d53184e824399814cbfcd01b93e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:19Z,use_quota=True,user_id='31ad231f1cee4d4d904ca71882528eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Creating volume a995d2a3-279f-4142-b99a-de65e8640e01 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:33 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:33 devstack sudo[98453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01 1073741824
Nov 07 02:41:33 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d5dc08-634d-4b38-8936-088333be0d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034fb25f-d074-42b3-90f0-286507c76e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:33 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Volume volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974 (90e10e7b-8ebf-4625-ba05-c33a8cc1c974): created successfully
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034fb25f-d074-42b3-90f0-286507c76e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Flow 'volume_create_manager' (cbc6623e-2c63-4393-b9ef-23d6d1e0e551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d4c919b9-f460-4165-ac31-f8bedc40ce4b tempest-AttachVolumeTestJSON-1343838001 None] Created volume successfully.
Nov 07 02:41:33 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01 1073741824" returned: 0 in 0.527s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:33 devstack sudo[98459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01
Nov 07 02:41:33 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:34 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01" returned: 0 in 0.324s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.671s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-371135547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b32a13-4ebe-48ce-90c6-948d36f72edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78d53184e824399814cbfcd01b93e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:19Z,use_quota=True,user_id='31ad231f1cee4d4d904ca71882528eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Creating volume 08b32a13-4ebe-48ce-90c6-948d36f72edb {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:34 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b35927-e4d7-4934-8c52-1a8017a80b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a995d2a3-279f-4142-b99a-de65e8640e01', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d003299-e5d9-4e95-8320-cf5cfbee5460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Volume volume-a995d2a3-279f-4142-b99a-de65e8640e01 (a995d2a3-279f-4142-b99a-de65e8640e01): created successfully
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d003299-e5d9-4e95-8320-cf5cfbee5460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:34 devstack sudo[98496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb 1073741824
Nov 07 02:41:34 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Flow 'volume_create_manager' (78ae4ce9-4da7-4b40-aac0-5c7558c27d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-525ba6f8-4934-420a-88bb-7a512b247fc4 tempest-CreateVolumesFromImageTest-1114267935 None] Created volume successfully.
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:34 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb 1073741824" returned: 0 in 0.758s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:34 devstack sudo[98508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb
Nov 07 02:41:34 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:35 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb" returned: 0 in 0.312s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.346s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1792100204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb981203-58a5-4bc4-9f43-2ec15895815e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78d53184e824399814cbfcd01b93e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:20Z,use_quota=True,user_id='31ad231f1cee4d4d904ca71882528eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Creating volume fb981203-58a5-4bc4-9f43-2ec15895815e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:35 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70bbfad-8da7-4cde-b60e-4055f1b3ccc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b32a13-4ebe-48ce-90c6-948d36f72edb', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3e33a2-dd04-4e88-a94d-adca1102fff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:35 devstack sudo[98511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e 1073741824
Nov 07 02:41:35 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Volume volume-08b32a13-4ebe-48ce-90c6-948d36f72edb (08b32a13-4ebe-48ce-90c6-948d36f72edb): created successfully
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3e33a2-dd04-4e88-a94d-adca1102fff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Flow 'volume_create_manager' (d6f3f99d-8508-4941-bf15-c2581f187d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1d0f01d3-9fc3-420e-a69e-144eb01c3a4a tempest-CreateVolumesFromImageTest-1114267935 None] Created volume successfully.
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-89df913b-8570-48b5-873f-aa6f6e12bd67 req-9f790e24-84be-4ea7-b89b-a0cca9b57a9a tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:35 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e 1073741824" returned: 0 in 0.526s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:35 devstack sudo[98525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e
Nov 07 02:41:35 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:36 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.761s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-670323830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada747c6-3414-4309-8d14-064d30d45fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78d53184e824399814cbfcd01b93e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:20Z,use_quota=True,user_id='31ad231f1cee4d4d904ca71882528eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Creating volume ada747c6-3414-4309-8d14-064d30d45fae {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:36 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04ffd85-a483-41cd-9729-924d8359a4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb981203-58a5-4bc4-9f43-2ec15895815e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:36 devstack sudo[98528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae 1073741824
Nov 07 02:41:36 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4c4b44-ab56-4ef6-b6a8-9db6c20f551b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Volume volume-fb981203-58a5-4bc4-9f43-2ec15895815e (fb981203-58a5-4bc4-9f43-2ec15895815e): created successfully
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4c4b44-ab56-4ef6-b6a8-9db6c20f551b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Flow 'volume_create_manager' (8a2924bf-198c-4656-aaf3-195ff39bfee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-82fbee86-7c34-4bc5-9afb-e621d51f9929 tempest-CreateVolumesFromImageTest-1114267935 None] Created volume successfully.
Nov 07 02:41:36 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae 1073741824" returned: 0 in 0.454s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:36 devstack sudo[98533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae
Nov 07 02:41:36 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:36 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae" returned: 0 in 0.268s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.167s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1710535885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117e3df7-dcea-4aca-8f5a-5c58815d3722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78d53184e824399814cbfcd01b93e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:20Z,use_quota=True,user_id='31ad231f1cee4d4d904ca71882528eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Creating volume 117e3df7-dcea-4aca-8f5a-5c58815d3722 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:36 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934a1d04-56df-4b43-a0f2-26c022a5569a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada747c6-3414-4309-8d14-064d30d45fae', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:36 devstack sudo[98536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722 1073741824
Nov 07 02:41:36 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5a8488-b34a-46e9-8741-d26a032d02c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Volume volume-ada747c6-3414-4309-8d14-064d30d45fae (ada747c6-3414-4309-8d14-064d30d45fae): created successfully
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5a8488-b34a-46e9-8741-d26a032d02c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Flow 'volume_create_manager' (1256f955-d880-45c1-9301-574229676105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c1d5b7a0-a0e0-4996-a962-181865ed084a tempest-CreateVolumesFromImageTest-1114267935 None] Created volume successfully.
Nov 07 02:41:37 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722 1073741824" returned: 0 in 0.488s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:37 devstack sudo[98557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722
Nov 07 02:41:37 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:37 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722" returned: 0 in 0.272s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.287s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4207314-a684-4505-a199-c33b8801f7c2]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd87d40-cc67-4269-93e6-81a5785c2b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117e3df7-dcea-4aca-8f5a-5c58815d3722', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae5d76a-fe09-4459-8482-0ba4d8f4fd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Volume volume-117e3df7-dcea-4aca-8f5a-5c58815d3722 (117e3df7-dcea-4aca-8f5a-5c58815d3722): created successfully
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae5d76a-fe09-4459-8482-0ba4d8f4fd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Flow 'volume_create_manager' (a8c5b1f3-c5be-449c-a3b0-4c03df385f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-06a3f000-be6f-4b5d-8010-5fe9f63f5395 tempest-CreateVolumesFromImageTest-1114267935 None] Created volume successfully.
Nov 07 02:41:37 devstack sudo[98560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507
Nov 07 02:41:37 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "cinder-117e3df7-dcea-4aca-8f5a-5c58815d3722-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-117e3df7-dcea-4aca-8f5a-5c58815d3722-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:38 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "cinder-quobyte-117e3df7-dcea-4aca-8f5a-5c58815d3722" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507" returned: 0 in 0.434s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-quobyte-117e3df7-dcea-4aca-8f5a-5c58815d3722" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[887542bb-a5cb-48a3-b14f-58ea97dcca70]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5334c60-bf87-4445-af38-002d89efec4c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:38 devstack sudo[98566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507
Nov 07 02:41:38 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:38 devstack sudo[98567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722
Nov 07 02:41:38 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:38 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507" returned: 0 in 0.377s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:38 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722" returned: 0 in 0.391s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:38 devstack sudo[98576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img
Nov 07 02:41:38 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:38 devstack sudo[98577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722
Nov 07 02:41:38 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:38 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-117e3df7-dcea-4aca-8f5a-5c58815d3722" returned: 0 in 0.246s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-quobyte-117e3df7-dcea-4aca-8f5a-5c58815d3722" released by "delete_volume" :: held 0.681s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Created reservations ['d2621244-3e31-41c6-8d55-19a53439a16e', '60916eeb-084d-4d95-ba45-190d869f039d', '6467b92e-0c8c-4d46-88be-e9da3ffe5f34', '760606e8-ccbe-44e4-a931-1e48d4da0bc3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:39 devstack sudo[98591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:41:39 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "cinder-ada747c6-3414-4309-8d14-064d30d45fae-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-ada747c6-3414-4309-8d14-064d30d45fae-delete_volume" acquired by "delete_volume" :: waited 0.167s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:39 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.567s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:39 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Deleted volume successfully.
Nov 07 02:41:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "cinder-quobyte-ada747c6-3414-4309-8d14-064d30d45fae" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-11a32c61-e1f6-4b97-a2f0-e8ffbbdea066 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-117e3df7-dcea-4aca-8f5a-5c58815d3722-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-quobyte-ada747c6-3414-4309-8d14-064d30d45fae" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e38f20-0577-4d04-9f38-575ca7f1cdaa]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:39 devstack sudo[98594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae
Nov 07 02:41:39 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:40 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae" returned: 0 in 0.569s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:40 devstack sudo[98599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae
Nov 07 02:41:40 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:40 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ada747c6-3414-4309-8d14-064d30d45fae" returned: 0 in 0.356s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-quobyte-ada747c6-3414-4309-8d14-064d30d45fae" released by "delete_volume" :: held 1.039s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:40 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Created reservations ['866937fd-39ce-4859-9da9-78e3f011a206', 'c3cafb9a-64fd-4508-ba0f-baddc7b0fc04', '0ce97fc1-1dcd-45d7-b419-1842bba8ed54', 'f93e9ebe-4128-4535-8379-510f7200e2b3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:40 devstack sudo[98604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:41:40 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:41 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.414s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:41 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Deleted volume successfully.
Nov 07 02:41:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e80af73-fd3f-4cc4-91e6-29d6eaa3e84e tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-ada747c6-3414-4309-8d14-064d30d45fae-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "cinder-fb981203-58a5-4bc4-9f43-2ec15895815e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-fb981203-58a5-4bc4-9f43-2ec15895815e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "cinder-quobyte-fb981203-58a5-4bc4-9f43-2ec15895815e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-quobyte-fb981203-58a5-4bc4-9f43-2ec15895815e" acquired by "delete_volume" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:42 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b01bf76-31ba-4bb6-a9eb-1a7fab33cece]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:42 devstack sudo[98621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e
Nov 07 02:41:42 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:42 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e" returned: 0 in 0.596s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:42 devstack sudo[98626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e
Nov 07 02:41:42 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:43 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fb981203-58a5-4bc4-9f43-2ec15895815e" returned: 0 in 0.449s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-quobyte-fb981203-58a5-4bc4-9f43-2ec15895815e" released by "delete_volume" :: held 1.146s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Created reservations ['d5d25351-4ed4-459c-839b-0213cdde8443', '121a1c6a-a23b-45b5-b0fe-859b07a22806', '89a33693-912c-42b5-b022-bd54411e31ad', 'e9247ec9-6465-4987-88f1-fbc2d4f93931'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:43 devstack sudo[98629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:41:43 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:43 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.437s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Deleted volume successfully.
Nov 07 02:41:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ca05155-bb21-4b06-93d8-a9e6e1ab5267 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-fb981203-58a5-4bc4-9f43-2ec15895815e-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "cinder-08b32a13-4ebe-48ce-90c6-948d36f72edb-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-08b32a13-4ebe-48ce-90c6-948d36f72edb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "cinder-quobyte-08b32a13-4ebe-48ce-90c6-948d36f72edb" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-quobyte-08b32a13-4ebe-48ce-90c6-948d36f72edb" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[82251ae0-04a1-45bc-b308-6b2779915347]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:44 devstack sudo[98632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb
Nov 07 02:41:44 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:45 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb" returned: 0 in 0.716s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:45 devstack sudo[98638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb
Nov 07 02:41:45 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:45 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-08b32a13-4ebe-48ce-90c6-948d36f72edb" returned: 0 in 0.371s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-quobyte-08b32a13-4ebe-48ce-90c6-948d36f72edb" released by "delete_volume" :: held 1.179s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:45 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Created reservations ['e5c3beef-0646-4741-b0b4-df2d4c7b4f7f', '2d605987-c9ed-40d9-a077-8ed6298b3def', '9e1b5307-5b6a-4f26-ae67-77073e290399', 'e57f1768-ecac-4f33-86d9-d226851415c0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:45 devstack sudo[98641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:41:45 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:46 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.457s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Deleted volume successfully.
Nov 07 02:41:46 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img" returned: 0 in 7.947s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09a0afa-465c-446a-a0df-6146797aea93]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:46 devstack sudo[98652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507
Nov 07 02:41:46 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-aa1709c1-1d3a-4ffc-ac85-51ab5fd7c42c tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-08b32a13-4ebe-48ce-90c6-948d36f72edb-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "cinder-a995d2a3-279f-4142-b99a-de65e8640e01-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-a995d2a3-279f-4142-b99a-de65e8640e01-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "cinder-quobyte-a995d2a3-279f-4142-b99a-de65e8640e01" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-quobyte-a995d2a3-279f-4142-b99a-de65e8640e01" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6cfaa6-5ef6-4168-aa0b-e02698d2e6ff]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:46 devstack sudo[98658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01
Nov 07 02:41:46 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:47 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507" returned: 0 in 0.574s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:41:47 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Converted 1024.00 MB image at 128.83 MB/s
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] c1336851-0d0f-4405-b0f7-9bd91011e6c5 was raw, converting to qcow2 {{(pid=87087) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cca427-2b13-4508-81f7-247d6831d191]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:47 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img
Nov 07 02:41:47 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:47 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01" returned: 0 in 0.397s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:47 devstack sudo[98667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01
Nov 07 02:41:47 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:47 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img" returned: 0 in 0.383s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:47 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a995d2a3-279f-4142-b99a-de65e8640e01" returned: 0 in 0.268s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-quobyte-a995d2a3-279f-4142-b99a-de65e8640e01" released by "delete_volume" :: held 0.726s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Created reservations ['c39a280b-b3ce-4c5a-b671-a8105878c6c9', '61c5a87f-6fa5-4e9c-9532-f1717c2b5d2d', 'e3a205d9-7de3-45d1-b87a-d83c9d36141e', 'a0b080e2-8fb2-4a7f-88d8-24a45647f5d0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:47 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img
Nov 07 02:41:47 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:47 devstack sudo[98676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:41:47 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:47 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img" returned: 1 in 0.518s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:41:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img /opt/stack/data/cinder/conversion/vol_upload_sr0drsi3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:48 devstack sudo[98681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img /opt/stack/data/cinder/conversion/vol_upload_sr0drsi3
Nov 07 02:41:48 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:48 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.426s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:48 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Deleted volume successfully.
Nov 07 02:41:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef75734-7403-4d38-825a-b6c2aec0d387 tempest-CreateVolumesFromImageTest-1114267935 None] Lock "cinder-a995d2a3-279f-4142-b99a-de65e8640e01-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:48 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img /opt/stack/data/cinder/conversion/vol_upload_sr0drsi3" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:48 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Image conversion details: src /opt/stack/data/cinder/conversion/e0043993-1bca-4f78-bb80-4c7e28383507.temp_image.c1336851-0d0f-4405-b0f7-9bd91011e6c59jhx3ykj.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_sr0drsi3 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:41:48 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 07 02:41:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db5cf7d-060d-42ba-8062-925fb5e5a7d4]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sr0drsi3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:48 devstack sudo[98687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sr0drsi3
Nov 07 02:41:48 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:48 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sr0drsi3" returned: 0 in 0.431s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-c25ea868-05f9-47d2-9b05-5c12e5c0f29e req-e7f06c86-b119-42b0-a24d-6646ea5004ab tempest-TestMinimumBasicScenario-54896219 None] Terminate volume connection completed successfully.
Nov 07 02:41:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-c25ea868-05f9-47d2-9b05-5c12e5c0f29e req-e7f06c86-b119-42b0-a24d-6646ea5004ab tempest-TestMinimumBasicScenario-54896219 None] Deleting attachment 2e733ed3-94a4-481a-8e75-5e4251407c46. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:41:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.090s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Uploaded volume to glance image-id: c1336851-0d0f-4405-b0f7-9bd91011e6c5. {{(pid=87087) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 07 02:41:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-89df913b-8570-48b5-873f-aa6f6e12bd67 req-9f790e24-84be-4ea7-b89b-a0cca9b57a9a tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.213s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Acquiring lock "cinder-96c92a0d-966e-4a4d-933d-c77b1f0f9272-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-89df913b-8570-48b5-873f-aa6f6e12bd67 req-9f790e24-84be-4ea7-b89b-a0cca9b57a9a tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-345bd428-ccbc-467f-99d4-781a97ff8a01 tempest-VolumesActionsTest-928946301 None] Copy volume to image completed successfully.
Nov 07 02:41:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Lock "cinder-96c92a0d-966e-4a4d-933d-c77b1f0f9272-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-89df913b-8570-48b5-873f-aa6f6e12bd67 req-9f790e24-84be-4ea7-b89b-a0cca9b57a9a tempest-AttachVolumeTestJSON-1343838001 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e758246-e451-4de3-afe4-001fb2958810', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:41:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Acquiring lock "cinder-quobyte-96c92a0d-966e-4a4d-933d-c77b1f0f9272" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Lock "cinder-quobyte-96c92a0d-966e-4a4d-933d-c77b1f0f9272" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-89df913b-8570-48b5-873f-aa6f6e12bd67 req-9f790e24-84be-4ea7-b89b-a0cca9b57a9a tempest-AttachVolumeTestJSON-1343838001 None] attachment_update completed successfully.
Nov 07 02:41:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d164932-5b19-443d-8903-c1807b4a1062]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:51 devstack sudo[98699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272
Nov 07 02:41:51 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:51 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272" returned: 0 in 0.444s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:51 devstack sudo[99117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272
Nov 07 02:41:51 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:51 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-96c92a0d-966e-4a4d-933d-c77b1f0f9272" returned: 0 in 0.371s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Lock "cinder-quobyte-96c92a0d-966e-4a4d-933d-c77b1f0f9272" released by "delete_volume" :: held 0.880s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Created reservations ['1cf80589-a362-4249-a6e2-efa6fa08898e', '0ce0f273-4e12-4b0f-88bc-ea9f7deabd8f', 'dfb6e646-a45f-49bf-a9a6-211a5821f981', '4c2973e8-8df1-422a-a3a7-ef497b669c94'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:51 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:52 devstack sudo[99121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:41:52 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (a67ab9d0-ef7a-475a-9c0b-790304e43f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3846ac-b7c3-4dfe-a86e-88af1a78fa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Acquiring lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3846ac-b7c3-4dfe-a86e-88af1a78fa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1832108228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd66664-879b-40cc-a8c5-1e7f6852dd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:52Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e315af-c3e2-4baa-b092-40ed725bc769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e315af-c3e2-4baa-b092-40ed725bc769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ca4665-5956-4232-974a-234a661025a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ca4665-5956-4232-974a-234a661025a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd66664-879b-40cc-a8c5-1e7f6852dd16', 'volume_name': 'volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f748d68a-27f4-4772-89b8-87202aa59a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f748d68a-27f4-4772-89b8-87202aa59a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce36a244-0544-48a7-be02-fa2dd441de68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:52 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume 0bd66664-879b-40cc-a8c5-1e7f6852dd16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16', 'volume_size': 1}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1832108228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd66664-879b-40cc-a8c5-1e7f6852dd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:52Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Creating volume 0bd66664-879b-40cc-a8c5-1e7f6852dd16 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:52 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:52 devstack sudo[99123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16 1073741824
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:52 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Acquiring lock "cinder-quobyte-e0043993-1bca-4f78-bb80-4c7e28383507" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Lock "cinder-quobyte-e0043993-1bca-4f78-bb80-4c7e28383507" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[492de747-7eae-4577-b55b-ff0469d09266]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:52 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.338s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Deleted volume successfully.
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53c32380-7b8f-44bd-abb8-1f62ae7c3406 tempest-TestMinimumBasicScenario-54896219 None] Lock "cinder-96c92a0d-966e-4a4d-933d-c77b1f0f9272-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:52 devstack sudo[99126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507
Nov 07 02:41:52 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:52 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16 1073741824" returned: 0 in 0.719s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:52 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507" returned: 0 in 0.643s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:52 devstack sudo[99151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16
Nov 07 02:41:52 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:52 devstack sudo[99155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507
Nov 07 02:41:52 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:53 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e0043993-1bca-4f78-bb80-4c7e28383507" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Lock "cinder-quobyte-e0043993-1bca-4f78-bb80-4c7e28383507" released by "delete_volume" :: held 1.070s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:53 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Created reservations ['8f02226c-c9ab-48c2-a809-b848646e33bc', 'ad5b531f-0b39-430c-b913-a0b4e8dae8bb', '23012188-db4f-4507-91ab-e9025f5e3363', '3ff98c32-3ed8-4604-9f75-39b1f96de17a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16" returned: 0 in 0.539s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:53 devstack sudo[99161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:41:53 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce36a244-0544-48a7-be02-fa2dd441de68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ededd29e-6e14-476b-a056-1aef767655d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16 (0bd66664-879b-40cc-a8c5-1e7f6852dd16): created successfully
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ededd29e-6e14-476b-a056-1aef767655d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (a67ab9d0-ef7a-475a-9c0b-790304e43f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:53 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d572607d-4449-4d43-a8e3-187f3e50832c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created volume successfully.
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:53 devstack sudo[99163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:41:53 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:53 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.399s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:41:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:41:54 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.500s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Deleted volume successfully.
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6aa93f6b-ce8b-4369-9a0e-206d9f34c7e9 tempest-VolumesActionsTest-928946301 None] Lock "cinder-e0043993-1bca-4f78-bb80-4c7e28383507-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Flow 'volume_create_manager' (bfc254a8-b003-4a17-babf-824f9c577239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e7fdaf-ee6b-4def-bfc8-3c75e065bf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e7fdaf-ee6b-4def-bfc8-3c75e065bf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-34784572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e111b4-31fe-4788-a0c0-a194f429f54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b372c6112384a7b8b103f2998b53c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:54Z,use_quota=True,user_id='03468e7635374428944d4ad755bdf882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3fd821-d0d7-472f-87da-ffc1e1becc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3fd821-d0d7-472f-87da-ffc1e1becc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25ae94e-eeeb-4d9c-9d8e-9e5bae644490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25ae94e-eeeb-4d9c-9d8e-9e5bae644490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e111b4-31fe-4788-a0c0-a194f429f54a', 'volume_name': 'volume-92e111b4-31fe-4788-a0c0-a194f429f54a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8053769-46f9-4669-a3d8-35eafbed359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8053769-46f9-4669-a3d8-35eafbed359e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e862b4d-622b-4c07-93f9-366feacf65fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Volume 92e111b4-31fe-4788-a0c0-a194f429f54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e111b4-31fe-4788-a0c0-a194f429f54a', 'volume_size': 1}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-34784572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e111b4-31fe-4788-a0c0-a194f429f54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b372c6112384a7b8b103f2998b53c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:54Z,use_quota=True,user_id='03468e7635374428944d4ad755bdf882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Creating volume 92e111b4-31fe-4788-a0c0-a194f429f54a {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:54 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:54 devstack sudo[99169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a 1073741824
Nov 07 02:41:54 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (416ea54b-15fe-442b-8865-0608c21941f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c497b55e-058d-4aae-89a7-ab3f7be0ff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c497b55e-058d-4aae-89a7-ab3f7be0ff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-965837653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d74bb6-1bc4-40de-8c05-9c4b957c7d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:55Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d20343-ac26-486d-8d1b-96edb6cfcb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d20343-ac26-486d-8d1b-96edb6cfcb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ab2fc6-0684-468a-9252-b20087f67410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ab2fc6-0684-468a-9252-b20087f67410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89d74bb6-1bc4-40de-8c05-9c4b957c7d5f', 'volume_name': 'volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b47e30-3b6e-493d-9643-4686779df40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b47e30-3b6e-493d-9643-4686779df40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de12011-9ecd-4175-8328-0a25515b5b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume 89d74bb6-1bc4-40de-8c05-9c4b957c7d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f', 'volume_size': 1}
Nov 07 02:41:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:55 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a 1073741824" returned: 0 in 0.767s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:55 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a
Nov 07 02:41:55 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (8e8ebcb4-ad85-4e32-bb72-0263a0544486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9011ebe1-49d7-4087-97f0-86927b418766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9011ebe1-49d7-4087-97f0-86927b418766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-321607812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:55Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deffe826-1a81-4792-99a7-9b87a001786d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deffe826-1a81-4792-99a7-9b87a001786d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f1fd74-fc92-47bd-8a1e-2c7f1482d10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f1fd74-fc92-47bd-8a1e-2c7f1482d10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe', 'volume_name': 'volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e78cee-b0eb-4f91-aac1-34f3d7e7f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e78cee-b0eb-4f91-aac1-34f3d7e7f456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69d1d87-4178-4716-b306-ee53fdc940df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume 296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe', 'volume_size': 1}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:55 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a" returned: 0 in 0.331s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-965837653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d74bb6-1bc4-40de-8c05-9c4b957c7d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:55Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Creating volume 89d74bb6-1bc4-40de-8c05-9c4b957c7d5f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:55 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e862b4d-622b-4c07-93f9-366feacf65fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e111b4-31fe-4788-a0c0-a194f429f54a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack sudo[99179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f 1073741824
Nov 07 02:41:55 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b707e33e-cf69-4a01-8f51-ca2a4ef503ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Volume volume-92e111b4-31fe-4788-a0c0-a194f429f54a (92e111b4-31fe-4788-a0c0-a194f429f54a): created successfully
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b707e33e-cf69-4a01-8f51-ca2a4ef503ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Flow 'volume_create_manager' (bfc254a8-b003-4a17-babf-824f9c577239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-79d288d5-8303-4fbf-a3b7-7eb721bdce41 tempest-AttachVolumeTestJSON-1343838001 None] Created volume successfully.
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (c93da687-a127-4216-8ae8-ec35e2b4b57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba13007f-7489-4251-bdbe-8ff6b0d94531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba13007f-7489-4251-bdbe-8ff6b0d94531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-530462921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142ed7fb-c389-4d53-bfe6-86bf6927727b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:56Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9633793d-5c84-4663-bd28-49d2aa22ac2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9633793d-5c84-4663-bd28-49d2aa22ac2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c42def-c609-4114-9c97-68abedb870f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c42def-c609-4114-9c97-68abedb870f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '142ed7fb-c389-4d53-bfe6-86bf6927727b', 'volume_name': 'volume-142ed7fb-c389-4d53-bfe6-86bf6927727b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d8ecad-68b5-42aa-bce5-55a64b18741e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d8ecad-68b5-42aa-bce5-55a64b18741e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8aaa440-eb08-46ce-a3ff-97a20f51a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume 142ed7fb-c389-4d53-bfe6-86bf6927727b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-142ed7fb-c389-4d53-bfe6-86bf6927727b', 'volume_size': 1}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:56 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f 1073741824" returned: 0 in 0.538s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:56 devstack sudo[99186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f
Nov 07 02:41:56 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (0d9af5df-650d-4888-a7ad-5fae59db21d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e34bd8-94ac-4fdd-9436-31b2897d4e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e34bd8-94ac-4fdd-9436-31b2897d4e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611963139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5c994d-1aa4-4b43-8997-f4e0bef98de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:56Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1555b616-7817-42e7-86b0-19326a8ca02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1555b616-7817-42e7-86b0-19326a8ca02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60a5a12-2169-4c50-b134-1b7e76de7cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60a5a12-2169-4c50-b134-1b7e76de7cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5c994d-1aa4-4b43-8997-f4e0bef98de6', 'volume_name': 'volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc9421b-8702-41ad-8ab9-da69a6b4fbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc9421b-8702-41ad-8ab9-da69a6b4fbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:56 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f19515-dd5f-4dc3-b2cc-63c6909dabeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume 2b5c994d-1aa4-4b43-8997-f4e0bef98de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6', 'volume_size': 1}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f" returned: 0 in 0.453s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.193s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-321607812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:55Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Creating volume 296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:56 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de12011-9ecd-4175-8328-0a25515b5b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6b7990-be5f-45a7-9169-652d1e180da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f (89d74bb6-1bc4-40de-8c05-9c4b957c7d5f): created successfully
Nov 07 02:41:56 devstack sudo[99192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe 1073741824
Nov 07 02:41:56 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6b7990-be5f-45a7-9169-652d1e180da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (416ea54b-15fe-442b-8865-0608c21941f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:56 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d275304e-360c-4590-b279-b24433f922f7 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created volume successfully.
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (6a41a0ad-675c-49c6-9b30-d0a1609db5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f56381c-2612-4aaa-b143-7903dbba680c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f56381c-2612-4aaa-b143-7903dbba680c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1131306007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d468570-5a8a-46c5-970b-98906f4fcc7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:57Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb13a96-e0a9-4e5a-a88f-3ea8d5ff88d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb13a96-e0a9-4e5a-a88f-3ea8d5ff88d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3358545-5b55-4e48-8308-e9bffc18481d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3358545-5b55-4e48-8308-e9bffc18481d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d468570-5a8a-46c5-970b-98906f4fcc7f', 'volume_name': 'volume-6d468570-5a8a-46c5-970b-98906f4fcc7f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01af9caf-532d-4030-bd6f-b850c300bb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01af9caf-532d-4030-bd6f-b850c300bb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9743ac-d898-4b76-8951-1a4aae891e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume 6d468570-5a8a-46c5-970b-98906f4fcc7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d468570-5a8a-46c5-970b-98906f4fcc7f', 'volume_size': 1}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:57 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe 1073741824" returned: 0 in 0.752s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:57 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe
Nov 07 02:41:57 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-0b37cb2b-8166-4bb7-a965-db41c59c9b1d req-27fa7633-f41d-4ef3-9d48-ba46490dc542 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:57 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe" returned: 0 in 0.375s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.821s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-530462921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142ed7fb-c389-4d53-bfe6-86bf6927727b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:56Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Creating volume 142ed7fb-c389-4d53-bfe6-86bf6927727b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:57 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69d1d87-4178-4716-b306-ee53fdc940df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98ba57f-6a48-41f3-9355-1f5193a5663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:57 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b 1073741824
Nov 07 02:41:57 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe (296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe): created successfully
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98ba57f-6a48-41f3-9355-1f5193a5663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (8e8ebcb4-ad85-4e32-bb72-0263a0544486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b32b08e8-1b57-4cbc-89d1-6fc9b8d7498b tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created volume successfully.
Nov 07 02:41:58 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b 1073741824" returned: 0 in 0.544s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:58 devstack sudo[99217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b
Nov 07 02:41:58 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:58 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.143s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611963139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5c994d-1aa4-4b43-8997-f4e0bef98de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:56Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Creating volume 2b5c994d-1aa4-4b43-8997-f4e0bef98de6 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:58 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:58 devstack sudo[99221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6 1073741824
Nov 07 02:41:58 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8aaa440-eb08-46ce-a3ff-97a20f51a909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-142ed7fb-c389-4d53-bfe6-86bf6927727b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a275cf88-ac4f-4a1b-b40c-283c7144d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume volume-142ed7fb-c389-4d53-bfe6-86bf6927727b (142ed7fb-c389-4d53-bfe6-86bf6927727b): created successfully
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a275cf88-ac4f-4a1b-b40c-283c7144d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (c93da687-a127-4216-8ae8-ec35e2b4b57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f2b0c85c-3cac-43ea-a8c4-842333fdef0c tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created volume successfully.
Nov 07 02:41:59 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6 1073741824" returned: 0 in 0.471s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:59 devstack sudo[99227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6
Nov 07 02:41:59 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:59 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6" returned: 0 in 0.290s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.426s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1131306007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d468570-5a8a-46c5-970b-98906f4fcc7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576cb635218f4d55b150afb946e8f87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:57Z,use_quota=True,user_id='519c7bba284b44eeac0caeb9eb65108d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Creating volume 6d468570-5a8a-46c5-970b-98906f4fcc7f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:59 devstack sudo[99230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f 1073741824
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f19515-dd5f-4dc3-b2cc-63c6909dabeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:59 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442cb512-836b-4819-b7bc-2e81710325d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6 (2b5c994d-1aa4-4b43-8997-f4e0bef98de6): created successfully
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442cb512-836b-4819-b7bc-2e81710325d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (0d9af5df-650d-4888-a7ad-5fae59db21d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-861aa316-5513-4f09-a423-51237d48a9b0 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created volume successfully.
Nov 07 02:42:00 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f 1073741824" returned: 0 in 0.573s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:00 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f
Nov 07 02:42:00 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:00 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f" returned: 0 in 0.261s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-0b37cb2b-8166-4bb7-a965-db41c59c9b1d req-27fa7633-f41d-4ef3-9d48-ba46490dc542 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.793s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9743ac-d898-4b76-8951-1a4aae891e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d468570-5a8a-46c5-970b-98906f4fcc7f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bde469e-3625-4078-964a-72240ca3e16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-0b37cb2b-8166-4bb7-a965-db41c59c9b1d req-27fa7633-f41d-4ef3-9d48-ba46490dc542 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:00 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Volume volume-6d468570-5a8a-46c5-970b-98906f4fcc7f (6d468570-5a8a-46c5-970b-98906f4fcc7f): created successfully
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bde469e-3625-4078-964a-72240ca3e16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Flow 'volume_create_manager' (6a41a0ad-675c-49c6-9b30-d0a1609db5b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-749c3210-29a8-4488-bf3d-d1e50f88f81f tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created volume successfully.
Nov 07 02:42:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-0b37cb2b-8166-4bb7-a965-db41c59c9b1d req-27fa7633-f41d-4ef3-9d48-ba46490dc542 tempest-AttachVolumeTestJSON-1343838001 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-92e111b4-31fe-4788-a0c0-a194f429f54a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fdaac61d-9860-45a7-bfdb-dfb11020a3c9', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:42:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-0b37cb2b-8166-4bb7-a965-db41c59c9b1d req-27fa7633-f41d-4ef3-9d48-ba46490dc542 tempest-AttachVolumeTestJSON-1343838001 None] attachment_update completed successfully.
Nov 07 02:42:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-6d468570-5a8a-46c5-970b-98906f4fcc7f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-6d468570-5a8a-46c5-970b-98906f4fcc7f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-quobyte-6d468570-5a8a-46c5-970b-98906f4fcc7f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-6d468570-5a8a-46c5-970b-98906f4fcc7f" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d90bf8c-fd4e-479a-aab4-eec83a0432c0]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:01 devstack sudo[99242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f
Nov 07 02:42:01 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:02 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f" returned: 0 in 0.574s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:02 devstack sudo[99250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f
Nov 07 02:42:02 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:02 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6d468570-5a8a-46c5-970b-98906f4fcc7f" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-6d468570-5a8a-46c5-970b-98906f4fcc7f" released by "delete_volume" :: held 1.047s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:02 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created reservations ['dbde4fb0-2ad0-411e-aaee-3655208097e6', '3748639d-0282-4d3c-b66c-d230c9f9d452', 'e76f4631-e55a-4af1-ad5e-bc61ecc8cb1b', 'c9969766-a0a3-442c-a997-535e73f71bda'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:02 devstack sudo[99253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:02 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-53d66f63-7d75-4cf0-b5f4-ad963e6f97d9 req-ab432120-2e4a-41ca-84e9-03c2b333d552 tempest-AttachVolumeTestJSON-1343838001 None] Terminate volume connection completed successfully.
Nov 07 02:42:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-53d66f63-7d75-4cf0-b5f4-ad963e6f97d9 req-ab432120-2e4a-41ca-84e9-03c2b333d552 tempest-AttachVolumeTestJSON-1343838001 None] Deleting attachment 2e758246-e451-4de3-afe4-001fb2958810. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:42:03 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.311s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:03 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Deleted volume successfully.
Nov 07 02:42:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c484a8-f480-4b2b-8f6c-fd10ba2420f3 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-6d468570-5a8a-46c5-970b-98906f4fcc7f-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-2b5c994d-1aa4-4b43-8997-f4e0bef98de6-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-2b5c994d-1aa4-4b43-8997-f4e0bef98de6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-quobyte-2b5c994d-1aa4-4b43-8997-f4e0bef98de6" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-2b5c994d-1aa4-4b43-8997-f4e0bef98de6" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f38bda6-5e35-47a4-978a-2171055b7624]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:04 devstack sudo[99259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6
Nov 07 02:42:04 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:04 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6" returned: 0 in 0.513s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:04 devstack sudo[99264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6
Nov 07 02:42:04 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-903a9c72-8c05-47a0-93a3-3229904d4efc req-ebfcc0d6-f347-423f-a835-8a28847a9186 tempest-AttachVolumeTestJSON-1343838001 None] Terminate volume connection completed successfully.
Nov 07 02:42:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-903a9c72-8c05-47a0-93a3-3229904d4efc req-ebfcc0d6-f347-423f-a835-8a28847a9186 tempest-AttachVolumeTestJSON-1343838001 None] Deleting attachment fdaac61d-9860-45a7-bfdb-dfb11020a3c9. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:42:04 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2b5c994d-1aa4-4b43-8997-f4e0bef98de6" returned: 0 in 0.350s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-2b5c994d-1aa4-4b43-8997-f4e0bef98de6" released by "delete_volume" :: held 0.941s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created reservations ['4d65d10a-afaf-4f4d-9d1a-808edcf81a22', 'ba3f2749-4b17-47f8-9678-b4537856aa60', '64c727cd-07a1-428e-8bfe-8d11ab0676ce', '267e355d-cfe7-4634-9a96-e04064b87bdd'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:05 devstack sudo[99294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:05 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Flow 'volume_create_manager' (bd4d41c8-06f1-4f9f-a98e-8207eb857ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdeb71b4-6616-48a0-a112-21657c99692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdeb71b4-6616-48a0-a112-21657c99692b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1099830071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25bf563-8793-47c2-805f-47e3b18aada9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8cf3d0fe7d4ad0b3923256be276eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:05Z,use_quota=True,user_id='b23dd68dc3cb4853ac8ae5f341b7fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ade26b-bba1-4183-8c36-f73b6fc44d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ade26b-bba1-4183-8c36-f73b6fc44d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1a24f8-9383-4cb0-9091-55764bd3d68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1a24f8-9383-4cb0-9091-55764bd3d68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b25bf563-8793-47c2-805f-47e3b18aada9', 'volume_name': 'volume-b25bf563-8793-47c2-805f-47e3b18aada9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8de97a-ea05-45f4-bec8-18a1850688c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8de97a-ea05-45f4-bec8-18a1850688c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722b25dd-29ba-476e-9635-26d72ce0aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:05 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Volume b25bf563-8793-47c2-805f-47e3b18aada9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b25bf563-8793-47c2-805f-47e3b18aada9', 'volume_size': 1}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1099830071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25bf563-8793-47c2-805f-47e3b18aada9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8cf3d0fe7d4ad0b3923256be276eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:05Z,use_quota=True,user_id='b23dd68dc3cb4853ac8ae5f341b7fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Creating volume b25bf563-8793-47c2-805f-47e3b18aada9 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:42:05 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:05 devstack sudo[99296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 1073741824
Nov 07 02:42:05 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:05 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Deleted volume successfully.
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-602c4313-c012-4a46-acbf-75c7f6c6aef2 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-2b5c994d-1aa4-4b43-8997-f4e0bef98de6-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:05 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 1073741824" returned: 0 in 0.572s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:05 devstack sudo[99303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9
Nov 07 02:42:05 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-142ed7fb-c389-4d53-bfe6-86bf6927727b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:06 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9" returned: 0 in 0.314s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-142ed7fb-c389-4d53-bfe6-86bf6927727b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722b25dd-29ba-476e-9635-26d72ce0aa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b25bf563-8793-47c2-805f-47e3b18aada9', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336927e8-cf92-4909-bbd2-414eed6a44c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:06 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Volume volume-b25bf563-8793-47c2-805f-47e3b18aada9 (b25bf563-8793-47c2-805f-47e3b18aada9): created successfully
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336927e8-cf92-4909-bbd2-414eed6a44c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Flow 'volume_create_manager' (bd4d41c8-06f1-4f9f-a98e-8207eb857ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-quobyte-142ed7fb-c389-4d53-bfe6-86bf6927727b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-15cb0de2-e622-4db3-b456-f9b991b7174b tempest-VolumesCloneTest-1993097114 None] Created volume successfully.
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-142ed7fb-c389-4d53-bfe6-86bf6927727b" acquired by "delete_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a633e55c-ac98-40eb-97d9-9d4935cf1af2]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:06 devstack sudo[99318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b
Nov 07 02:42:06 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:06 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b" returned: 0 in 0.534s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:07 devstack sudo[99331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b
Nov 07 02:42:07 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:07 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-142ed7fb-c389-4d53-bfe6-86bf6927727b" returned: 0 in 0.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-142ed7fb-c389-4d53-bfe6-86bf6927727b" released by "delete_volume" :: held 0.955s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created reservations ['be300f68-76b5-490e-8d32-ed2b4a7d3265', 'd66def39-f99a-4c42-8b42-447809520b89', 'b7e1ccfa-e341-4b23-8541-769057152083', '8ad44385-59d5-43a2-a41c-d73e96bae533'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:07 devstack sudo[99335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:07 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:07 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.369s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Deleted volume successfully.
Nov 07 02:42:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4645bf3-a5d0-4e21-952c-8b1feed272c1 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-142ed7fb-c389-4d53-bfe6-86bf6927727b-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Flow 'volume_create_manager' (d4f55a73-880e-489d-be38-70f9830dc9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce67834d-8e52-4028-b989-fcdb6dfff1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce67834d-8e52-4028-b989-fcdb6dfff1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1391501516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22043cdd-b0d7-450f-be62-97d4535c5e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8cf3d0fe7d4ad0b3923256be276eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=b25bf563-8793-47c2-805f-47e3b18aada9,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:08Z,use_quota=True,user_id='b23dd68dc3cb4853ac8ae5f341b7fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09101b4-ed08-4490-8c51-6c757587e36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09101b4-ed08-4490-8c51-6c757587e36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f53568-9fad-4d53-9756-72aa3619ebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f53568-9fad-4d53-9756-72aa3619ebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '22043cdd-b0d7-450f-be62-97d4535c5e3c', 'volume_name': 'volume-22043cdd-b0d7-450f-be62-97d4535c5e3c', 'volume_size': 2, 'source_volid': 'b25bf563-8793-47c2-805f-47e3b18aada9', 'source_volstatus': 'available'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c26b46-03ce-449e-89ec-71f17c41bf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c26b46-03ce-449e-89ec-71f17c41bf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a3b862-4349-45f3-9b46-8819b13026c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Volume 22043cdd-b0d7-450f-be62-97d4535c5e3c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-22043cdd-b0d7-450f-be62-97d4535c5e3c', 'volume_size': 2, 'source_volid': 'b25bf563-8793-47c2-805f-47e3b18aada9', 'source_volstatus': 'available'}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:08 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Cloning volume b25bf563-8793-47c2-805f-47e3b18aada9 to volume 22043cdd-b0d7-450f-be62-97d4535c5e3c
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Creating offline snapshot 4531d3bc-4756-4848-8cf6-c1b9d069844c of volume b25bf563-8793-47c2-805f-47e3b18aada9 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[52be568f-9b89-42ed-92cd-cc010b53e48a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-quobyte-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f01caf-444d-454e-b8bc-786bbd400755]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:08 devstack sudo[99342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9
Nov 07 02:42:08 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:08 devstack sudo[99344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe
Nov 07 02:42:08 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:08 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9" returned: 0 in 0.491s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:08 devstack sudo[99349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c 1G
Nov 07 02:42:08 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:09 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe" returned: 0 in 0.448s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:09 devstack sudo[99354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe
Nov 07 02:42:09 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:09 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe" returned: 0 in 0.307s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:09 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c 1G" returned: 0 in 0.480s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25bf563-8793-47c2-805f-47e3b18aada9 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe" released by "delete_volume" :: held 0.822s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:09 devstack sudo[99361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25bf563-8793-47c2-805f-47e3b18aada9 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c
Nov 07 02:42:09 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created reservations ['5c7a8322-c911-4baf-b334-dc3c090cd38c', 'fee1ef17-91b7-4025-8986-1e86b7533731', '9ada0e14-7cb0-4c35-b465-8f75378a1b4f', '251bef0b-4126-4126-8d65-580d837170e5'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:09 devstack sudo[99363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:09 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-quobyte-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81e8d54-06b9-4c82-90ee-439bc3e82f67]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:09 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25bf563-8793-47c2-805f-47e3b18aada9 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c" returned: 0 in 0.557s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:09 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c is being set with open permissions: ugo+rw
Nov 07 02:42:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:10 devstack sudo[99371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c
Nov 07 02:42:10 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:10 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.479s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:10 devstack sudo[99369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f
Nov 07 02:42:10 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Deleted volume successfully.
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-83eb4283-f795-43af-a8ca-1b9b839e96be tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-296ddb65-e3ed-493b-b9fc-eff2a8d9e7fe-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:10 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:10 devstack sudo[99376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.info
Nov 07 02:42:10 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:10 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f" returned: 0 in 0.513s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:10 devstack sudo[99380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f
Nov 07 02:42:10 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:10 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "cinder-92e111b4-31fe-4788-a0c0-a194f429f54a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.info" returned: 0 in 0.371s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:10 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.info is being set with open permissions: ugo+rw
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-92e111b4-31fe-4788-a0c0-a194f429f54a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:10 devstack sudo[99383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.info
Nov 07 02:42:10 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "cinder-quobyte-92e111b4-31fe-4788-a0c0-a194f429f54a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:10 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f" returned: 0 in 0.397s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-quobyte-92e111b4-31fe-4788-a0c0-a194f429f54a" acquired by "delete_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f" released by "delete_volume" :: held 0.986s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d84cc4d-9c36-49db-9043-bab1313a0577]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:10 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created reservations ['21270c24-5a7f-4c7c-ac71-d56141db5cea', '0bd24121-9231-47d4-a2c0-dad4a5c59f32', '05743c80-1373-4bdc-83b0-78a96b0784d7', '3d8d2550-aaf7-426e-8096-5572e53d8266'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:11 devstack sudo[99386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a
Nov 07 02:42:11 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:11 devstack sudo[99389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:11 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:11 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.info" returned: 0 in 0.426s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Acquiring lock "cinder-quobyte-22043cdd-b0d7-450f-be62-97d4535c5e3c" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-quobyte-22043cdd-b0d7-450f-be62-97d4535c5e3c" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] snapshot: 4531d3bc-4756-4848-8cf6-c1b9d069844c, volume: 22043cdd-b0d7-450f-be62-97d4535c5e3c,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0b2de9-2e81-44a2-ac76-5f60dc9e9118]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:11 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:11 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a" returned: 0 in 0.439s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.293s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Deleted volume successfully.
Nov 07 02:42:11 devstack sudo[99391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c
Nov 07 02:42:11 devstack sudo[99397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a
Nov 07 02:42:11 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:11 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2b825da2-f59f-426e-bbbc-edccceaeb645 tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-89d74bb6-1bc4-40de-8c05-9c4b957c7d5f-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:11 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-92e111b4-31fe-4788-a0c0-a194f429f54a" returned: 0 in 0.299s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-quobyte-92e111b4-31fe-4788-a0c0-a194f429f54a" released by "delete_volume" :: held 0.827s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:11 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c" returned: 0 in 0.450s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25bf563-8793-47c2-805f-47e3b18aada9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[970acd21-6ce2-4ad7-bf6a-f105ba4d7d23]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Created reservations ['e8c98a4c-ec10-4315-8289-4f446dcc7d4f', '893bd28e-31d1-4417-bbab-2816f433511b', 'c7e22360-4154-4012-9220-55171cefd843', '77024e21-eb31-4280-b06a-1bd953867128'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:11 devstack sudo[99404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9
Nov 07 02:42:11 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:11 devstack sudo[99406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:11 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "cinder-90e10e7b-8ebf-4625-ba05-c33a8cc1c974-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-90e10e7b-8ebf-4625-ba05-c33a8cc1c974-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "cinder-quobyte-90e10e7b-8ebf-4625-ba05-c33a8cc1c974" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-quobyte-90e10e7b-8ebf-4625-ba05-c33a8cc1c974" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-0bd66664-879b-40cc-a8c5-1e7f6852dd16-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e81f68-4147-4f45-875f-be38d296261e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-0bd66664-879b-40cc-a8c5-1e7f6852dd16-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:12 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "cinder-quobyte-0bd66664-879b-40cc-a8c5-1e7f6852dd16" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9" returned: 0 in 0.488s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-0bd66664-879b-40cc-a8c5-1e7f6852dd16" acquired by "delete_volume" :: waited 0.041s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:12 devstack sudo[99413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c
Nov 07 02:42:12 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:12 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.453s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a45a988-38c6-442a-930b-c2e819d14634]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Deleted volume successfully.
Nov 07 02:42:12 devstack sudo[99411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974
Nov 07 02:42:12 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-762a2e85-485b-43ac-9498-cb15168350fc tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-92e111b4-31fe-4788-a0c0-a194f429f54a-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:12 devstack sudo[99415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16
Nov 07 02:42:12 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:12 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974" returned: 0 in 0.583s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:12 devstack sudo[99427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974
Nov 07 02:42:12 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:12 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16" returned: 0 in 0.519s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:12 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16
Nov 07 02:42:12 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:13 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-90e10e7b-8ebf-4625-ba05-c33a8cc1c974" returned: 0 in 0.591s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-quobyte-90e10e7b-8ebf-4625-ba05-c33a8cc1c974" released by "delete_volume" :: held 1.291s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:13 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0bd66664-879b-40cc-a8c5-1e7f6852dd16" returned: 0 in 0.637s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-quobyte-0bd66664-879b-40cc-a8c5-1e7f6852dd16" released by "delete_volume" :: held 1.257s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Created reservations ['6a2dedf1-18fc-484b-ad5e-25e322972e16', 'a614354e-d7a2-40e6-9bbd-72369fc67861', '3ac9d4e0-bd59-49c3-af98-542dcf7dab78', 'd99a5aad-161f-4a8f-b4bf-d11af53b5559'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Created reservations ['a545a90a-be64-44c5-ad6a-6bea45343b8b', 'a5029d52-13c9-4365-a8fa-76de9a6a3869', 'ca733faf-392d-45ce-88f6-872d3cf721ff', '1e39e83e-2637-4f61-b0ab-2747a2ac964d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:13 devstack sudo[99442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:13 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:14 devstack sudo[99444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:14 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:14 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.624s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:14 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Deleted volume successfully.
Nov 07 02:42:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-44b92ec6-3d43-4bc4-89d6-f3febfb90e04 tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-90e10e7b-8ebf-4625-ba05-c33a8cc1c974-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:14 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.724s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:14 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Deleted volume successfully.
Nov 07 02:42:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "cinder-16092ac5-da30-491f-a9b0-315066242f59-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-16092ac5-da30-491f-a9b0-315066242f59-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d1765457-3f86-4a42-9230-426a8cd6141e tempest-CreateVolumesFromSourceVolumeTest-964630427 None] Lock "cinder-0bd66664-879b-40cc-a8c5-1e7f6852dd16-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "cinder-quobyte-16092ac5-da30-491f-a9b0-315066242f59" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-quobyte-16092ac5-da30-491f-a9b0-315066242f59" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac2c643-1dc2-4f66-a3f7-cc56c9ca077e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:15 devstack sudo[99449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59
Nov 07 02:42:15 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:15 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59" returned: 0 in 0.878s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:16 devstack sudo[99454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59
Nov 07 02:42:16 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:16 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-16092ac5-da30-491f-a9b0-315066242f59" returned: 0 in 0.581s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-quobyte-16092ac5-da30-491f-a9b0-315066242f59" released by "delete_volume" :: held 1.580s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:16 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Created reservations ['5ca19f4f-4ff4-4e63-bb8b-4d76afb66f8a', '6bc8fb94-aa0d-419c-9c55-23151efc6c70', 'ec265b7a-2971-4cd1-968c-ec60e8410419', '3e7152ed-83df-4bdb-b1d4-99206f9d91c0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:17 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:17 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:17 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.683s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:17 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Deleted volume successfully.
Nov 07 02:42:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fdb730d4-c2f5-4ef8-8b5b-5aeaf5dae495 tempest-AttachVolumeTestJSON-1343838001 None] Lock "cinder-16092ac5-da30-491f-a9b0-315066242f59-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:21 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c" returned: 0 in 9.073s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:21 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9, size 1024.00 MB, duration 9.08 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:42:21 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Converted 1024.00 MB image at 112.83 MB/s
Nov 07 02:42:21 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c is being set with open permissions: ugo+rw
Nov 07 02:42:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:21 devstack sudo[99462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c
Nov 07 02:42:21 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:21 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c" returned: 0 in 0.268s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-quobyte-22043cdd-b0d7-450f-be62-97d4535c5e3c" released by "_copy_volume_from_snapshot" :: held 10.396s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Acquiring lock "cinder-quobyte-4531d3bc-4756-4848-8cf6-c1b9d069844c" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-quobyte-4531d3bc-4756-4848-8cf6-c1b9d069844c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Deleting offline snapshot 4531d3bc-4756-4848-8cf6-c1b9d069844c of volume b25bf563-8793-47c2-805f-47e3b18aada9 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:42:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] snapshot_file for this snap is: volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:42:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7594cb3f-a312-4cd1-9fa0-1ff0de7a595e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:21 devstack sudo[99465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c
Nov 07 02:42:21 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:22 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25bf563-8793-47c2-805f-47e3b18aada9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f210d6f9-a923-4680-8222-b907dbe8de8d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:22 devstack sudo[99471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9
Nov 07 02:42:22 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:22 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9" returned: 0 in 0.686s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:22 devstack sudo[99476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c
Nov 07 02:42:22 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:23 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c" returned: 0 in 0.366s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:23 devstack sudo[99482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c
Nov 07 02:42:23 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:23 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9.4531d3bc-4756-4848-8cf6-c1b9d069844c" returned: 0 in 0.340s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-quobyte-4531d3bc-4756-4848-8cf6-c1b9d069844c" released by "_delete_snapshot" :: held 1.921s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.223s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a3b862-4349-45f3-9b46-8819b13026c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22043cdd-b0d7-450f-be62-97d4535c5e3c', 'volume_size': 2, 'source_volid': 'b25bf563-8793-47c2-805f-47e3b18aada9', 'source_volstatus': 'available'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e546e3-a0e2-4f6d-b1ea-3accfbfd52a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:23 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Volume volume-22043cdd-b0d7-450f-be62-97d4535c5e3c (22043cdd-b0d7-450f-be62-97d4535c5e3c): created successfully
Nov 07 02:42:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e546e3-a0e2-4f6d-b1ea-3accfbfd52a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Flow 'volume_create_manager' (d4f55a73-880e-489d-be38-70f9830dc9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-27d9658e-dd86-4a94-9317-c5c30d9959b3 tempest-VolumesCloneTest-1993097114 None] Created volume successfully.
Nov 07 02:42:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Acquiring lock "cinder-22043cdd-b0d7-450f-be62-97d4535c5e3c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-22043cdd-b0d7-450f-be62-97d4535c5e3c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Acquiring lock "cinder-quobyte-22043cdd-b0d7-450f-be62-97d4535c5e3c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-quobyte-22043cdd-b0d7-450f-be62-97d4535c5e3c" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35e7f35-d324-4ddf-b021-f45c0cacfb13]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:24 devstack sudo[99486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c
Nov 07 02:42:24 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:24 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c" returned: 0 in 0.448s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:24 devstack sudo[99491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c
Nov 07 02:42:24 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:25 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-22043cdd-b0d7-450f-be62-97d4535c5e3c" returned: 0 in 0.307s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-quobyte-22043cdd-b0d7-450f-be62-97d4535c5e3c" released by "delete_volume" :: held 0.826s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Created reservations ['b1f45cb0-095a-45cb-a131-1e22c73169ac', 'b65e5a00-edf2-471d-aeef-96f66f5f5e5e', '81500ff3-751e-4e16-9949-e8be11f94189', '8db57f25-97f3-4e16-a6fa-57fecec8bd33'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:25 devstack sudo[99494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:25 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Acquiring lock "cinder-b25bf563-8793-47c2-805f-47e3b18aada9-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-b25bf563-8793-47c2-805f-47e3b18aada9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Acquiring lock "cinder-quobyte-b25bf563-8793-47c2-805f-47e3b18aada9" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-quobyte-b25bf563-8793-47c2-805f-47e3b18aada9" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:25 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.390s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Deleted volume successfully.
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a6c94d-eeec-493e-aa89-0850e1cc79f6]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-652d686b-e509-4a38-85d9-8a9fa4a1d7f8 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-22043cdd-b0d7-450f-be62-97d4535c5e3c-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:25 devstack sudo[99498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9
Nov 07 02:42:25 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:26 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9" returned: 0 in 0.454s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:26 devstack sudo[99504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9
Nov 07 02:42:26 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:26 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b25bf563-8793-47c2-805f-47e3b18aada9" returned: 0 in 0.267s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-quobyte-b25bf563-8793-47c2-805f-47e3b18aada9" released by "delete_volume" :: held 0.830s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:26 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Created reservations ['75c4646b-4ec9-4d6e-966d-77c1d7560655', '8033492e-ddf1-42f3-b4e1-31df84c06d87', 'f0c77017-f1e3-4ac1-8cd5-cd94409e9b39', '53dd57b6-fa60-4efa-baf0-93d0b606306d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:26 devstack sudo[99507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:26 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:26 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.319s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:27 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Deleted volume successfully.
Nov 07 02:42:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-338f2d30-864f-4538-8b35-4eca962a68e0 tempest-VolumesCloneTest-1993097114 None] Lock "cinder-b25bf563-8793-47c2-805f-47e3b18aada9-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=199,cinder:SELECT=129,cinder:INSERT=44,cinder:DELETE=16 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=143,cinder:INSERT=45,cinder:UPDATE=185,cinder:DELETE=17 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (155063d6-a85e-4674-9de4-89b2f36afcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a2bd1d-c09b-4dd5-8c8a-38255698e612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a2bd1d-c09b-4dd5-8c8a-38255698e612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-834252485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270eb712-cdf4-4c81-92a1-1d0bcb56e4e4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:33Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7f929b-c599-4027-ae2c-f81f63b83654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7f929b-c599-4027-ae2c-f81f63b83654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5978d5d0-dd25-4f8d-8dd2-130eb9a9084a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5978d5d0-dd25-4f8d-8dd2-130eb9a9084a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270eb712-cdf4-4c81-92a1-1d0bcb56e4e4', 'volume_name': 'volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c78db3-1bed-4fad-b669-2b72e103fd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c78db3-1bed-4fad-b669-2b72e103fd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffdb563-d179-4a0e-8752-c855a95c257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Volume 270eb712-cdf4-4c81-92a1-1d0bcb56e4e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4', 'volume_size': 1}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-834252485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270eb712-cdf4-4c81-92a1-1d0bcb56e4e4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:33Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Creating volume 270eb712-cdf4-4c81-92a1-1d0bcb56e4e4 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:42:32 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:42:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:32 devstack sudo[99513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4 1073741824
Nov 07 02:42:32 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:33 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4 1073741824" returned: 0 in 0.518s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:33 devstack sudo[99519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4
Nov 07 02:42:33 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:33 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:42:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffdb563-d179-4a0e-8752-c855a95c257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55abf471-59db-4beb-b1ca-c7e24336f3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:33 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Volume volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4 (270eb712-cdf4-4c81-92a1-1d0bcb56e4e4): created successfully
Nov 07 02:42:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55abf471-59db-4beb-b1ca-c7e24336f3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (155063d6-a85e-4674-9de4-89b2f36afcb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fd50aee4-af0b-458d-ba5a-bf2c02bd102e tempest-VolumesGetTest-698435698 None] Created volume successfully.
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (b14cb7d3-2994-4ec7-a326-b36f03515821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9eae0ec-6cc1-4d76-a89a-2ffacdc6bcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9eae0ec-6cc1-4d76-a89a-2ffacdc6bcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1818458998',display_name='tempest-VolumesGetTest-Volume-1900619698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c01ac0-6a4f-49e2-bd0a-0ae3f159d648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:36Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4687d1e6-755d-41e8-86dc-9e4ad682e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4687d1e6-755d-41e8-86dc-9e4ad682e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20be244e-3851-473c-a71d-05ba785f4bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20be244e-3851-473c-a71d-05ba785f4bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c01ac0-6a4f-49e2-bd0a-0ae3f159d648', 'volume_name': 'volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d4b59a-c2ee-4a47-8f11-7488aac12878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d4b59a-c2ee-4a47-8f11-7488aac12878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ebb747-207c-4b34-8d15-136c8d928539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Volume 28c01ac0-6a4f-49e2-bd0a-0ae3f159d648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648', 'volume_size': 1}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1818458998',display_name='tempest-VolumesGetTest-Volume-1900619698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c01ac0-6a4f-49e2-bd0a-0ae3f159d648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:36Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Creating volume 28c01ac0-6a4f-49e2-bd0a-0ae3f159d648 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:42:35 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:42:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:35 devstack sudo[99558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648 1073741824
Nov 07 02:42:35 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:36 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648 1073741824" returned: 0 in 0.560s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:36 devstack sudo[99564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648
Nov 07 02:42:36 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:36 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648" returned: 0 in 0.311s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:42:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ebb747-207c-4b34-8d15-136c8d928539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f86a18-e9b8-4382-a4a6-37ef7ae0995d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Volume volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648 (28c01ac0-6a4f-49e2-bd0a-0ae3f159d648): created successfully
Nov 07 02:42:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f86a18-e9b8-4382-a4a6-37ef7ae0995d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (b14cb7d3-2994-4ec7-a326-b36f03515821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ff834890-0aed-4061-80f7-c01d68f6a914 tempest-VolumesGetTest-698435698 None] Created volume successfully.
Nov 07 02:42:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Lock "cinder-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-quobyte-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:38 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[363c87a9-9b19-41b0-a7a9-3d13923ede7d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:38 devstack sudo[99568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648
Nov 07 02:42:38 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:38 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648" returned: 0 in 0.450s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:38 devstack sudo[99573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648
Nov 07 02:42:38 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:38 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648" returned: 0 in 0.352s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648" released by "delete_volume" :: held 0.874s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Created reservations ['690f73ee-e3c5-4762-9a19-ef5bdd5575f1', 'd9107815-2c90-4fe3-9407-95eda07573b4', 'eed1f8fd-31d2-4398-8961-d00abae80126', 'aab5ae6c-0d32-4e74-934d-32d81a9de27b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:39 devstack sudo[99576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:39 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Lock "cinder-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-quobyte-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:39 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.382s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Deleted volume successfully.
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fede60-d90f-47a4-8c24-abeda1f19dd0]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d083d622-8281-4000-a049-5e6f797d6e07 tempest-VolumesGetTest-698435698 None] Lock "cinder-28c01ac0-6a4f-49e2-bd0a-0ae3f159d648-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:39 devstack sudo[99579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4
Nov 07 02:42:39 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:40 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4" returned: 0 in 0.572s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:40 devstack sudo[99584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4
Nov 07 02:42:40 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:40 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4" returned: 0 in 0.292s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4" released by "delete_volume" :: held 0.938s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Created reservations ['f66feacf-c5f7-4a6b-a7c4-c8322eb93d26', '44175288-cb6d-40a9-8c80-d3dcf39a3336', '5b499031-4c12-4343-bcea-0cc06be338d8', 'f246cf68-2fb7-40c9-8332-49953481ca54'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:40 devstack sudo[99589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:40 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:40 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:41 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Deleted volume successfully.
Nov 07 02:42:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8adc5690-6c51-4819-afd1-b51bd307bebb tempest-VolumesGetTest-698435698 None] Lock "cinder-270eb712-cdf4-4c81-92a1-1d0bcb56e4e4-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (d6e5335e-8303-4e4f-9d76-2514cb9b5653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b93868-24fd-419c-850f-87b69d4d4146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b93868-24fd-419c-850f-87b69d4d4146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-385693989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3a7533-aab8-4bb5-b1ba-f4490ab435a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:42Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800390e2-15c6-4868-95ba-c2fc0ed98061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800390e2-15c6-4868-95ba-c2fc0ed98061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891af7c5-4ddf-4243-ac62-9633fe80c722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891af7c5-4ddf-4243-ac62-9633fe80c722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3a7533-aab8-4bb5-b1ba-f4490ab435a8', 'volume_name': 'volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2141d5-8b91-4111-a1f5-f70879009c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2141d5-8b91-4111-a1f5-f70879009c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fba41a-c78e-4c28-8299-9cad5724904c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Volume 9e3a7533-aab8-4bb5-b1ba-f4490ab435a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8', 'volume_size': 1}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-385693989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3a7533-aab8-4bb5-b1ba-f4490ab435a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:42Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Creating volume 9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:42:42 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:42 devstack sudo[99592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 1073741824
Nov 07 02:42:42 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:42 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 1073741824" returned: 0 in 0.645s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:43 devstack sudo[99598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8
Nov 07 02:42:43 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:43 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8" returned: 0 in 0.276s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:42:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fba41a-c78e-4c28-8299-9cad5724904c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd4b42d-97ab-44d4-b35e-e63bc4fa4a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:43 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Volume volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 (9e3a7533-aab8-4bb5-b1ba-f4490ab435a8): created successfully
Nov 07 02:42:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd4b42d-97ab-44d4-b35e-e63bc4fa4a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (d6e5335e-8303-4e4f-9d76-2514cb9b5653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ae67b09b-b3ab-4a4d-8c42-c2f1d9953bd7 tempest-VolumesGetTest-698435698 None] Created volume successfully.
Nov 07 02:42:44 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (4ef7e63d-58ab-4c72-b2eb-7870ff290fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85daf256-8644-4ed3-8025-a58bb6a372d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85daf256-8644-4ed3-8025-a58bb6a372d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-462252955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf8acc4-57c4-4609-b82d-b1506293e359,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=9e3a7533-aab8-4bb5-b1ba-f4490ab435a8,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:45Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d01f8e-70e3-4edd-91ea-9920883e1d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d01f8e-70e3-4edd-91ea-9920883e1d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179d394a-9967-4f04-9738-f6976923cb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179d394a-9967-4f04-9738-f6976923cb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0cf8acc4-57c4-4609-b82d-b1506293e359', 'volume_name': 'volume-0cf8acc4-57c4-4609-b82d-b1506293e359', 'volume_size': 1, 'source_volid': '9e3a7533-aab8-4bb5-b1ba-f4490ab435a8', 'source_volstatus': 'available'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d207c79-9437-4f21-bbb2-c0d9c32a88e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d207c79-9437-4f21-bbb2-c0d9c32a88e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48719ebe-f996-47a4-9098-de2d7d981e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:45 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Volume 0cf8acc4-57c4-4609-b82d-b1506293e359: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0cf8acc4-57c4-4609-b82d-b1506293e359', 'volume_size': 1, 'source_volid': '9e3a7533-aab8-4bb5-b1ba-f4490ab435a8', 'source_volstatus': 'available'}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:45 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Cloning volume 9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 to volume 0cf8acc4-57c4-4609-b82d-b1506293e359
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Flow 'volume_create_manager' (f1cb2750-f93b-442b-aeb5-fbc1b338eead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed57d3b-4aaf-4666-9510-b2bf9e725246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Creating offline snapshot 0ba09939-680d-45b6-acfb-4994a5588be0 of volume 9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed57d3b-4aaf-4666-9510-b2bf9e725246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-344703014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fe4792-a73d-4f6d-beb4-effdda367cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5728bdd2089b4dacba4b3a3d3a7a5c49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:45Z,use_quota=True,user_id='a51bde49fc4e410c8c2838302161d726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0092584f-adc1-47ef-b510-d422fc278e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0092584f-adc1-47ef-b510-d422fc278e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a54a70-78ad-46fa-95f9-5c7276b3fb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a54a70-78ad-46fa-95f9-5c7276b3fb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2fe4792-a73d-4f6d-beb4-effdda367cd7', 'volume_name': 'volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b484a3-4985-4815-892e-57b2af158f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b484a3-4985-4815-892e-57b2af158f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc7ee14-eba0-48b6-bcd7-6a77a2feec63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:45 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Volume e2fe4792-a73d-4f6d-beb4-effdda367cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7', 'volume_size': 1}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ae8581-df59-43a1-a57d-2d3efec09ede]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:45 devstack sudo[99601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8
Nov 07 02:42:45 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:45 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8" returned: 0 in 0.382s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:45 devstack sudo[99607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0 1G
Nov 07 02:42:45 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:46 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0 1G" returned: 0 in 0.445s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:46 devstack sudo[99612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0
Nov 07 02:42:46 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:46 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:46 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0 is being set with open permissions: ugo+rw
Nov 07 02:42:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:46 devstack sudo[99623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0
Nov 07 02:42:46 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:46 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0" returned: 0 in 0.246s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:46 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.info
Nov 07 02:42:46 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:46 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.info" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:46 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.info is being set with open permissions: ugo+rw
Nov 07 02:42:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:46 devstack sudo[99629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.info
Nov 07 02:42:46 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:47 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.info" returned: 0 in 0.253s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-quobyte-0cf8acc4-57c4-4609-b82d-b1506293e359" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-0cf8acc4-57c4-4609-b82d-b1506293e359" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] snapshot: 0ba09939-680d-45b6-acfb-4994a5588be0, volume: 0cf8acc4-57c4-4609-b82d-b1506293e359,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[64767b64-6263-4f60-b65b-493d5f2650ba]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:47 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0
Nov 07 02:42:47 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:47 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0" returned: 0 in 0.376s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9d002a-d2cf-4d35-a2db-c273f348817c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:47 devstack sudo[99640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8
Nov 07 02:42:47 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:48 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8" returned: 0 in 0.410s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:42:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:42:48 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:42:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:48 devstack sudo[99646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359
Nov 07 02:42:48 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:42:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:53 devstack sudo[99691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:42:53 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:54 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.815s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:54 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:54 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:42:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:42:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:42:56 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=27,cinder:INSERT=5,cinder:SELECT=22,cinder:DELETE=3 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:42:56 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=20,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:42:57 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359" returned: 0 in 9.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:57 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8, size 1024.00 MB, duration 9.28 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:42:57 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Converted 1024.00 MB image at 110.36 MB/s
Nov 07 02:42:57 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359 is being set with open permissions: ugo+rw
Nov 07 02:42:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:57 devstack sudo[99753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359
Nov 07 02:42:57 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:57 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359" returned: 0 in 0.255s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-0cf8acc4-57c4-4609-b82d-b1506293e359" released by "_copy_volume_from_snapshot" :: held 10.412s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-quobyte-0ba09939-680d-45b6-acfb-4994a5588be0" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-0ba09939-680d-45b6-acfb-4994a5588be0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Deleting offline snapshot 0ba09939-680d-45b6-acfb-4994a5588be0 of volume 9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:42:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] snapshot_file for this snap is: volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:42:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc65c38-be92-4362-a896-8487a6ef9d6e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:57 devstack sudo[99757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0
Nov 07 02:42:57 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:58 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0" returned: 0 in 0.404s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:58 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea0de23-729a-4dac-95ea-e61ea10e9b81]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:58 devstack sudo[99763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8
Nov 07 02:42:58 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:58 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8" returned: 0 in 0.598s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:58 devstack sudo[99768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0
Nov 07 02:42:58 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:59 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0" returned: 0 in 0.381s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:59 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0
Nov 07 02:42:59 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:59 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8.0ba09939-680d-45b6-acfb-4994a5588be0" returned: 0 in 0.281s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-0ba09939-680d-45b6-acfb-4994a5588be0" released by "_delete_snapshot" :: held 1.803s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.434s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.332s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-344703014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fe4792-a73d-4f6d-beb4-effdda367cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5728bdd2089b4dacba4b3a3d3a7a5c49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:45Z,use_quota=True,user_id='a51bde49fc4e410c8c2838302161d726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Creating volume e2fe4792-a73d-4f6d-beb4-effdda367cd7 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:42:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48719ebe-f996-47a4-9098-de2d7d981e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf8acc4-57c4-4609-b82d-b1506293e359', 'volume_size': 1, 'source_volid': '9e3a7533-aab8-4bb5-b1ba-f4490ab435a8', 'source_volstatus': 'available'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:59 devstack sudo[99778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 1073741824
Nov 07 02:42:59 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9e7cbf-5ed0-437e-a0f2-5f7179ca4c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Volume volume-0cf8acc4-57c4-4609-b82d-b1506293e359 (0cf8acc4-57c4-4609-b82d-b1506293e359): created successfully
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9e7cbf-5ed0-437e-a0f2-5f7179ca4c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (4ef7e63d-58ab-4c72-b2eb-7870ff290fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9d212c43-6dc7-45bf-b833-000a5b826d35 tempest-VolumesGetTest-698435698 None] Created volume successfully.
Nov 07 02:43:00 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 1073741824" returned: 0 in 0.503s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:00 devstack sudo[99783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7
Nov 07 02:43:00 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:00 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7" returned: 0 in 0.265s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc7ee14-eba0-48b6-bcd7-6a77a2feec63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c358255-50bc-4e76-86ff-f341acbb001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:00 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Volume volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 (e2fe4792-a73d-4f6d-beb4-effdda367cd7): created successfully
Nov 07 02:43:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c358255-50bc-4e76-86ff-f341acbb001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Flow 'volume_create_manager' (f1cb2750-f93b-442b-aeb5-fbc1b338eead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7c810a9e-3f5b-4d03-aad6-3c3d5c1e5c1a tempest-TestImageHashVerification-1517910010 None] Created volume successfully.
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (80960f17-a7ba-44c2-a941-1cca255bac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1793aee5-6825-4a61-b240-f1b16cff4f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1793aee5-6825-4a61-b240-f1b16cff4f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1152408694',display_name='tempest-VolumesGetTest-Volume-1635286854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909de60b-d195-4bd4-bdbb-dc2b3bcdeff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:01Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e12104b-45da-44f6-a09a-82cbebf511bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e12104b-45da-44f6-a09a-82cbebf511bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed6c59a-119f-4f2c-ad47-e36d78bd6f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed6c59a-119f-4f2c-ad47-e36d78bd6f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909de60b-d195-4bd4-bdbb-dc2b3bcdeff6', 'volume_name': 'volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529e9a23-8d73-4117-a003-fcbb434973e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529e9a23-8d73-4117-a003-fcbb434973e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d7f234-b285-46b2-9595-b5c61ddfc4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:01 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Volume 909de60b-d195-4bd4-bdbb-dc2b3bcdeff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6', 'volume_size': 1}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1152408694',display_name='tempest-VolumesGetTest-Volume-1635286854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909de60b-d195-4bd4-bdbb-dc2b3bcdeff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:01Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Creating volume 909de60b-d195-4bd4-bdbb-dc2b3bcdeff6 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:01 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:01 devstack sudo[99786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6 1073741824
Nov 07 02:43:01 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:01 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6 1073741824" returned: 0 in 0.469s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:02 devstack sudo[99791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6
Nov 07 02:43:02 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:02 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6" returned: 0 in 0.258s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.441s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d7f234-b285-46b2-9595-b5c61ddfc4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6162ae-8a7d-4803-a869-32e7f157fbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f47dc7f-664c-4a53-aa0d-60f0b472e98b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:02 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Volume volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6 (909de60b-d195-4bd4-bdbb-dc2b3bcdeff6): created successfully
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6162ae-8a7d-4803-a869-32e7f157fbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (80960f17-a7ba-44c2-a941-1cca255bac78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a74ce2e3-d319-49fd-b23b-7767947629e7 tempest-VolumesGetTest-698435698 None] Created volume successfully.
Nov 07 02:43:02 devstack sudo[99794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7
Nov 07 02:43:02 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:02 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d21e3d-be52-49f2-9cb4-9bea91d48c47]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:02 devstack sudo[99799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7
Nov 07 02:43:02 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:03 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7" returned: 0 in 0.366s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 /opt/stack/data/cinder/conversion/e2fe4792-a73d-4f6d-beb4-effdda367cd7.temp_image.e9d89979-143a-4a36-84ff-343107c9c0ceqllp5fsl.img {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:03 devstack sudo[99804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 /opt/stack/data/cinder/conversion/e2fe4792-a73d-4f6d-beb4-effdda367cd7.temp_image.e9d89979-143a-4a36-84ff-343107c9c0ceqllp5fsl.img
Nov 07 02:43:03 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Lock "cinder-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-quobyte-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc01bac-f850-406b-881c-b08eee078441]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:04 devstack sudo[99817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6
Nov 07 02:43:04 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:04 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6" returned: 0 in 0.760s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:04 devstack sudo[99822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6
Nov 07 02:43:04 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:05 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6" returned: 0 in 0.572s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6" released by "delete_volume" :: held 1.428s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:05 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Created reservations ['18bb4b68-505e-42fc-9960-1d2b30244f8f', '5b23fd12-6ac8-4804-8a4f-fa6bedffdb96', '8bf24316-9eb8-4414-8c9b-670a5862c262', 'e51a895d-bd17-4303-a732-74a40428221f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:05 devstack sudo[99825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:43:05 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:06 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.491s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:06 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Deleted volume successfully.
Nov 07 02:43:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-546b45ee-5c7e-491e-956d-038500dc4e4c tempest-VolumesGetTest-698435698 None] Lock "cinder-909de60b-d195-4bd4-bdbb-dc2b3bcdeff6-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-0cf8acc4-57c4-4609-b82d-b1506293e359-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Lock "cinder-0cf8acc4-57c4-4609-b82d-b1506293e359-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-quobyte-0cf8acc4-57c4-4609-b82d-b1506293e359" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-0cf8acc4-57c4-4609-b82d-b1506293e359" acquired by "delete_volume" :: waited 0.056s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:06 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebbf89d-ae74-4192-a6c6-36f1a4454dcb]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:06 devstack sudo[99828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359
Nov 07 02:43:06 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:07 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359" returned: 0 in 0.773s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:07 devstack sudo[99833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359
Nov 07 02:43:07 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:07 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-0cf8acc4-57c4-4609-b82d-b1506293e359" returned: 0 in 0.565s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-0cf8acc4-57c4-4609-b82d-b1506293e359" released by "delete_volume" :: held 1.419s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Created reservations ['e9776065-bdc2-40d6-b242-59de94c10da0', '44e7e246-bd92-4d83-b72a-1d6f0e69f84f', '5b830840-9544-4236-8904-ba70d1aa7958', 'a0264537-1efc-4fda-980b-5aa4015202b6'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:08 devstack sudo[99837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:43:08 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:08 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.530s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Deleted volume successfully.
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-da47be96-7760-43e8-acf1-008e5d1834ce tempest-VolumesGetTest-698435698 None] Lock "cinder-0cf8acc4-57c4-4609-b82d-b1506293e359-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Lock "cinder-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-quobyte-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e22c52-0387-49e8-b8b5-e0da369dae8b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:09 devstack sudo[99841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8
Nov 07 02:43:09 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:10 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8" returned: 0 in 0.705s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:10 devstack sudo[99860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8
Nov 07 02:43:10 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:10 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8" returned: 0 in 0.387s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8" released by "delete_volume" :: held 1.245s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:10 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Created reservations ['34a52c71-11ba-4f11-a3bd-d0e30fba30f5', '543dc1d0-7aae-4233-a8fd-ec932fba7fc5', 'db6b59b1-cd47-4e5e-8b11-f7f30d0f3492', '27808ede-4feb-4ce4-9013-ff3e6c2f68f4'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:10 devstack sudo[99863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:43:10 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:11 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.400s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:11 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Deleted volume successfully.
Nov 07 02:43:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8a8945f9-3bc7-4363-9ce6-2a87c8ef0f18 tempest-VolumesGetTest-698435698 None] Lock "cinder-9e3a7533-aab8-4bb5-b1ba-f4490ab435a8-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:11 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 /opt/stack/data/cinder/conversion/e2fe4792-a73d-4f6d-beb4-effdda367cd7.temp_image.e9d89979-143a-4a36-84ff-343107c9c0ceqllp5fsl.img" returned: 0 in 8.122s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4f14e9-d033-4c70-bb7c-2685e89cef85]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:11 devstack sudo[99866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7
Nov 07 02:43:11 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:11 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7" returned: 0 in 0.575s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:11 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7, size 1024.00 MB, duration 8.12 sec, destination /opt/stack/data/cinder/conversion/e2fe4792-a73d-4f6d-beb4-effdda367cd7.temp_image.e9d89979-143a-4a36-84ff-343107c9c0ceqllp5fsl.img {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:43:11 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] Converted 1024.00 MB image at 126.07 MB/s
Nov 07 02:43:11 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] e9d89979-143a-4a36-84ff-343107c9c0ce was raw, no need to convert to raw {{(pid=87087) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (10969812-7a91-46cd-ade2-d8e4cd96fd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c769c0-9d7b-4cd3-bf95-2520a986788e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c769c0-9d7b-4cd3-bf95-2520a986788e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1216288584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a53eac8-0376-4117-a658-2d082732ba50,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:12Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314338a6-76cc-4685-b3c1-a597d8a324ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314338a6-76cc-4685-b3c1-a597d8a324ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b37abc-827d-49c4-84b2-c8187ef22a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b37abc-827d-49c4-84b2-c8187ef22a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a53eac8-0376-4117-a658-2d082732ba50', 'volume_name': 'volume-5a53eac8-0376-4117-a658-2d082732ba50', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb25d310>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c609ed16-dcc5-47ad-827a-a88f4a50c18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c609ed16-dcc5-47ad-827a-a88f4a50c18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81ba7bf-0987-4287-89b8-d3711a28967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Volume 5a53eac8-0376-4117-a658-2d082732ba50: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a53eac8-0376-4117-a658-2d082732ba50', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb25d310>}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Trying to clone 5a53eac8-0376-4117-a658-2d082732ba50 from image e17a9067-5798-44ad-877c-38fbc4f9665f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:43:12 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Image download 20.69 MB at 20.69 MB/s
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ca2d38-eec6-4e1d-857f-ad9544fdf09d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:12 devstack sudo[99872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD
Nov 07 02:43:12 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:13 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:13 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Temporary image e17a9067-5798-44ad-877c-38fbc4f9665f is fetched for user f205f51b856642348d19d9084eb00e0e. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:43:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[51de4094-9139-4b41-9a96-d9bda35bd2c2]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:13 devstack sudo[99877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD
Nov 07 02:43:13 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:13 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:19 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Flow 'volume_create_manager' (946a165a-37ab-4623-916f-9356c9952512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bc819a-bc43-48c7-b523-0a92fecb16e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bc819a-bc43-48c7-b523-0a92fecb16e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1130299480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d058ccb8-bb34-46ec-8473-55f4e5ecff44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce26d9495504ef897fa9c8322e90a8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:20Z,use_quota=True,user_id='b7016772c7fd4bddb836df39fe0b72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238b775e-6728-4bf4-9c25-489b652cc890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238b775e-6728-4bf4-9c25-489b652cc890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1559af31-0dfc-4785-8225-c9d46aea0eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1559af31-0dfc-4785-8225-c9d46aea0eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd058ccb8-bb34-46ec-8473-55f4e5ecff44', 'volume_name': 'volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3028d0fd-b4d7-48e5-bccb-2473f1820233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3028d0fd-b4d7-48e5-bccb-2473f1820233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc07aaa-fe80-430e-916c-00533393c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Volume d058ccb8-bb34-46ec-8473-55f4e5ecff44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44', 'volume_size': 1}
Nov 07 02:43:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:29 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=38,cinder:SELECT=21,cinder:DELETE=4,cinder:INSERT=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=30,cinder:SELECT=26,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.347s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] Uploaded volume to glance image-id: e9d89979-143a-4a36-84ff-343107c9c0ce. {{(pid=87087) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.100s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1216288584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a53eac8-0376-4117-a658-2d082732ba50,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:12Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Creating volume 5a53eac8-0376-4117-a658-2d082732ba50 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:30 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:43:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:30 devstack sudo[99891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50 1073741824
Nov 07 02:43:30 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-713c11d7-2941-410a-bf1d-090e00881f98 tempest-TestImageHashVerification-1517910010 None] Copy volume to image completed successfully.
Nov 07 02:43:31 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50 1073741824" returned: 0 in 0.418s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:31 devstack sudo[99896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50
Nov 07 02:43:31 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:31 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50" returned: 0 in 0.242s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.275s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1130299480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d058ccb8-bb34-46ec-8473-55f4e5ecff44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce26d9495504ef897fa9c8322e90a8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:20Z,use_quota=True,user_id='b7016772c7fd4bddb836df39fe0b72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Creating volume d058ccb8-bb34-46ec-8473-55f4e5ecff44 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:31 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:31 devstack sudo[99899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44 1073741824
Nov 07 02:43:31 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Attempting download of e17a9067-5798-44ad-877c-38fbc4f9665f ((None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}])) to volume 5a53eac8-0376-4117-a658-2d082732ba50. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6a12b9-02e8-44e8-a70d-1cebea4cc2a8]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_nsm6asrx {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:31 devstack sudo[99901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_nsm6asrx
Nov 07 02:43:31 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:31 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_nsm6asrx" returned: 0 in 0.381s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_nsm6asrx {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:31 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44 1073741824" returned: 0 in 0.505s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:31 devstack sudo[99909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44
Nov 07 02:43:31 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:31 devstack sudo[99908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_nsm6asrx
Nov 07 02:43:31 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Acquiring lock "cinder-e2fe4792-a73d-4f6d-beb4-effdda367cd7-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Lock "cinder-e2fe4792-a73d-4f6d-beb4-effdda367cd7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Acquiring lock "cinder-quobyte-e2fe4792-a73d-4f6d-beb4-effdda367cd7" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Lock "cinder-quobyte-e2fe4792-a73d-4f6d-beb4-effdda367cd7" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[907eebae-6913-4bb2-8993-eb3cac6619dc]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:32 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:32 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc07aaa-fe80-430e-916c-00533393c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69961b74-19fb-4753-8f25-31f434d20f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_nsm6asrx" returned: 1 in 0.395s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e17a9067-5798-44ad-877c-38fbc4f9665f_nsm6asrx' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaf65c5-e2ad-422f-9ace-ca7eeb40d43d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:32 devstack sudo[99912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7
Nov 07 02:43:32 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Volume volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44 (d058ccb8-bb34-46ec-8473-55f4e5ecff44): created successfully
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69961b74-19fb-4753-8f25-31f434d20f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Flow 'volume_create_manager' (946a165a-37ab-4623-916f-9356c9952512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-71df5902-918e-4d04-ad00-b47f2acb83d1 tempest-AttachVolumeNegativeTest-1898104544 None] Created volume successfully.
Nov 07 02:43:32 devstack sudo[99917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD
Nov 07 02:43:32 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:32 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7" returned: 0 in 0.375s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:32 devstack sudo[99922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7
Nov 07 02:43:32 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:32 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] e17a9067-5798-44ad-877c-38fbc4f9665f was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:32 devstack sudo[99927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50
Nov 07 02:43:32 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:32 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e2fe4792-a73d-4f6d-beb4-effdda367cd7" returned: 0 in 0.275s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Lock "cinder-quobyte-e2fe4792-a73d-4f6d-beb4-effdda367cd7" released by "delete_volume" :: held 0.714s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Created reservations ['1ec918d1-b06e-4c09-82c9-de30824fc2e2', '41b7a946-905b-46d1-8afb-bc8a6397d7ea', '76479b96-96e1-4bcf-a721-2f6539f4b47c', '5e75f505-f982-45c6-bf8d-43a9cea9aef8'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:32 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:43:32 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:33 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.369s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:33 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Deleted volume successfully.
Nov 07 02:43:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6ac70255-34d0-4b8a-a986-1975dd087ca7 tempest-TestImageHashVerification-1517910010 None] Lock "cinder-e2fe4792-a73d-4f6d-beb4-effdda367cd7-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-53641054-8671-49ff-9123-c8b00c8c0990 req-e9f67b38-2951-4189-9d69-b1a006f659ae tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-53641054-8671-49ff-9123-c8b00c8c0990 req-e9f67b38-2951-4189-9d69-b1a006f659ae tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-53641054-8671-49ff-9123-c8b00c8c0990 req-e9f67b38-2951-4189-9d69-b1a006f659ae tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-53641054-8671-49ff-9123-c8b00c8c0990 req-e9f67b38-2951-4189-9d69-b1a006f659ae tempest-AttachVolumeNegativeTest-1898104544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71071080-2d48-44c9-9b46-e5a7d5935211', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:43:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-53641054-8671-49ff-9123-c8b00c8c0990 req-e9f67b38-2951-4189-9d69-b1a006f659ae tempest-AttachVolumeNegativeTest-1898104544 None] attachment_update completed successfully.
Nov 07 02:43:35 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50" returned: 0 in 2.452s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e17a9067-5798-44ad-877c-38fbc4f9665f_c1gqucoadevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:43:35 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Converted 112.00 MB image at 45.65 MB/s
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:35 devstack sudo[100368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50 1G
Nov 07 02:43:35 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:35 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50 1G" returned: 0 in 0.373s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Downloaded image e17a9067-5798-44ad-877c-38fbc4f9665f ((None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}])) to volume 5a53eac8-0376-4117-a658-2d082732ba50 successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Temporary image e17a9067-5798-44ad-877c-38fbc4f9665f for user f205f51b856642348d19d9084eb00e0e is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Marking volume 5a53eac8-0376-4117-a658-2d082732ba50 as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Copying metadata from image e17a9067-5798-44ad-877c-38fbc4f9665f to 5a53eac8-0376-4117-a658-2d082732ba50. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Creating volume glance metadata for volume 5a53eac8-0376-4117-a658-2d082732ba50 backed by image e17a9067-5798-44ad-877c-38fbc4f9665f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81ba7bf-0987-4287-89b8-d3711a28967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a53eac8-0376-4117-a658-2d082732ba50', 'volume_size': 1, 'image_id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e17a9067-5798-44ad-877c-38fbc4f9665f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a407dd3a3af4bf487dd8232e4d14797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e17a9067-5798-44ad-877c-38fbc4f9665f', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e17a9067-5798-44ad-877c-38fbc4f9665f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb25d310>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b80616-d2b0-4a52-acc8-383e1f15bac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:35 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Volume volume-5a53eac8-0376-4117-a658-2d082732ba50 (5a53eac8-0376-4117-a658-2d082732ba50): created successfully
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b80616-d2b0-4a52-acc8-383e1f15bac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:35 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (10969812-7a91-46cd-ade2-d8e4cd96fd71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-93108655-d931-48f9-9442-71be2ab6abfe tempest-VolumesGetTest-698435698 None] Created volume successfully.
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (34a7ba59-bd72-4f2d-98a5-ad21668ec4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f324095-cc9b-4c46-aa98-133b66c87dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f324095-cc9b-4c46-aa98-133b66c87dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1762076223',display_name='tempest-VolumesGetTest-Volume-1364830005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6bac4c-3898-4563-bc04-7062a7b10eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:37Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e8a76c-ccaf-447c-9fe7-b5d969cd53b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e8a76c-ccaf-447c-9fe7-b5d969cd53b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75d1650-359b-4881-be43-a27852b73354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75d1650-359b-4881-be43-a27852b73354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6bac4c-3898-4563-bc04-7062a7b10eb3', 'volume_name': 'volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cc2841-a2c4-4f7b-9077-ed6b44701e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cc2841-a2c4-4f7b-9077-ed6b44701e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f9a709-cd90-4521-87e5-e19ae23b5e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:37 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Volume 2e6bac4c-3898-4563-bc04-7062a7b10eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3', 'volume_size': 1}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1762076223',display_name='tempest-VolumesGetTest-Volume-1364830005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6bac4c-3898-4563-bc04-7062a7b10eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471c3360f50344278b5034c60253ab1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:37Z,use_quota=True,user_id='f205f51b856642348d19d9084eb00e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Creating volume 2e6bac4c-3898-4563-bc04-7062a7b10eb3 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:37 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:43:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:37 devstack sudo[100412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3 1073741824
Nov 07 02:43:37 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:38 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3 1073741824" returned: 0 in 0.572s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:38 devstack sudo[100419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3
Nov 07 02:43:38 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:38 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3" returned: 0 in 0.355s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f9a709-cd90-4521-87e5-e19ae23b5e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7d8763-3b05-444e-88db-f4bfa6075879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Volume volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3 (2e6bac4c-3898-4563-bc04-7062a7b10eb3): created successfully
Nov 07 02:43:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7d8763-3b05-444e-88db-f4bfa6075879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Flow 'volume_create_manager' (34a7ba59-bd72-4f2d-98a5-ad21668ec4da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-84c92bc1-bfda-4a2a-97e5-2b3a3442ca52 tempest-VolumesGetTest-698435698 None] Created volume successfully.
Nov 07 02:43:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-2e6bac4c-3898-4563-bc04-7062a7b10eb3-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Lock "cinder-2e6bac4c-3898-4563-bc04-7062a7b10eb3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-quobyte-2e6bac4c-3898-4563-bc04-7062a7b10eb3" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-2e6bac4c-3898-4563-bc04-7062a7b10eb3" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2142c6-8aaf-44f7-86fb-dea4e6a539bc]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:39 devstack sudo[100426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3
Nov 07 02:43:39 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:40 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3" returned: 0 in 0.442s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:40 devstack sudo[100432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3
Nov 07 02:43:40 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:40 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2e6bac4c-3898-4563-bc04-7062a7b10eb3" returned: 0 in 0.334s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-2e6bac4c-3898-4563-bc04-7062a7b10eb3" released by "delete_volume" :: held 0.848s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:40 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Created reservations ['2f3873ac-8f94-4541-99fe-d1b378f4fcb6', '23e7375e-ca57-414e-8d71-ffa6efd33f51', '9d69d92a-fcc6-4d09-bdf7-88cf862e6168', '816d23e0-f769-4d87-b35c-6ef8a7e79538'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:40 devstack sudo[100439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:43:40 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-5a53eac8-0376-4117-a658-2d082732ba50-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Lock "cinder-5a53eac8-0376-4117-a658-2d082732ba50-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Acquiring lock "cinder-quobyte-5a53eac8-0376-4117-a658-2d082732ba50" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-5a53eac8-0376-4117-a658-2d082732ba50" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:41 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3398730-6734-4fe1-8837-b1ff10fb777f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:41 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.468s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:41 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Deleted volume successfully.
Nov 07 02:43:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5644e430-6bbc-4deb-b1a8-6b9cbcc65768 tempest-VolumesGetTest-698435698 None] Lock "cinder-2e6bac4c-3898-4563-bc04-7062a7b10eb3-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:41 devstack sudo[100450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50
Nov 07 02:43:41 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:41 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50" returned: 0 in 0.657s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:41 devstack sudo[100463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50
Nov 07 02:43:41 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:42 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a53eac8-0376-4117-a658-2d082732ba50" returned: 0 in 0.298s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Lock "cinder-quobyte-5a53eac8-0376-4117-a658-2d082732ba50" released by "delete_volume" :: held 1.020s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Created reservations ['a21a7ffe-6a54-4a96-8b02-1728206e8e80', '3e573eca-5193-4de3-864a-4312701f05c4', '81eef640-319f-44bc-abaa-fb8e0f772c22', '77a7a84e-27ed-4d56-ad52-5d467572da7c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:42 devstack sudo[100472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:43:42 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:42 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.316s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Deleted volume successfully.
Nov 07 02:43:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-754dd1aa-2d94-478d-a347-fd781203d183 tempest-VolumesGetTest-698435698 None] Lock "cinder-5a53eac8-0376-4117-a658-2d082732ba50-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Flow 'volume_create_manager' (e5ce5a79-2667-4115-81bf-b87d1b8aed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce10d906-b86b-4bc4-8b52-876134f1b7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce10d906-b86b-4bc4-8b52-876134f1b7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-954995775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11149c0-0a86-46ee-a7f9-5fb19f179d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6742b360efb947ba871c57ec3656fb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:49Z,use_quota=True,user_id='811cdcf3692a4d38b8b869770cee7394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc70f110-cdc9-4ea1-877b-daa47aef0ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc70f110-cdc9-4ea1-877b-daa47aef0ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e6917a-5d7e-4f67-b655-1fa2d392caf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e6917a-5d7e-4f67-b655-1fa2d392caf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11149c0-0a86-46ee-a7f9-5fb19f179d09', 'volume_name': 'volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727ced73-8496-49e6-9fc8-b25b1080ef86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727ced73-8496-49e6-9fc8-b25b1080ef86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08178324-1060-4e18-b1e2-226a7e57ec20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:49 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Volume e11149c0-0a86-46ee-a7f9-5fb19f179d09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09', 'volume_size': 1}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-954995775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11149c0-0a86-46ee-a7f9-5fb19f179d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6742b360efb947ba871c57ec3656fb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:49Z,use_quota=True,user_id='811cdcf3692a4d38b8b869770cee7394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Creating volume e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:49 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:43:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:49 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 1073741824
Nov 07 02:43:49 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:50 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 1073741824" returned: 0 in 0.756s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:50 devstack sudo[100535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09
Nov 07 02:43:50 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:50 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09" returned: 0 in 0.259s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08178324-1060-4e18-b1e2-226a7e57ec20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c38aa7-97a6-492f-85ec-a8ede7c6cc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:50 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Volume volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 (e11149c0-0a86-46ee-a7f9-5fb19f179d09): created successfully
Nov 07 02:43:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c38aa7-97a6-492f-85ec-a8ede7c6cc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Flow 'volume_create_manager' (e5ce5a79-2667-4115-81bf-b87d1b8aed5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-86bf965f-ec0f-44c3-a055-b28c108ca2be tempest-VolumesSnapshotListTestJSON-1881599792 None] Created volume successfully.
Nov 07 02:43:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] Creating offline snapshot dc3bfaed-f1cf-4197-a6d1-e527e8579f9b of volume e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:43:51 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[67726908-2c54-4d3a-a51c-a79b2f530eb7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:51 devstack sudo[100538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09
Nov 07 02:43:51 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:52 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09" returned: 0 in 0.387s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:52 devstack sudo[100543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b 1G
Nov 07 02:43:52 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:52 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b 1G" returned: 0 in 0.437s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:52 devstack sudo[100549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b
Nov 07 02:43:52 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:52 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:52 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b is being set with open permissions: ugo+rw
Nov 07 02:43:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:52 devstack sudo[100554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b
Nov 07 02:43:52 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:53 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b" returned: 0 in 0.268s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:53 devstack sudo[100557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.info
Nov 07 02:43:53 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:43:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:43:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:43:53 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.info" returned: 0 in 0.273s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:53 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.info is being set with open permissions: ugo+rw
Nov 07 02:43:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:53 devstack sudo[100560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.info
Nov 07 02:43:53 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:53 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.info" returned: 0 in 0.288s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:53 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fbdcf01f-0347-4719-8909-240939a6248f tempest-VolumesSnapshotListTestJSON-1881599792 None] Create snapshot completed successfully
Nov 07 02:43:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] Creating offline snapshot 3c660dc2-6a70-4c00-b965-f5582d15d5ea of volume e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:43:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b68e9b-3d12-43c7-bd31-9fb42c0bf92b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:55 devstack sudo[100587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b
Nov 07 02:43:55 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:55 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b" returned: 0 in 0.430s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:43:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:55 devstack sudo[100592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea 1G
Nov 07 02:43:55 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:56 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea 1G" returned: 0 in 0.553s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:56 devstack sudo[100598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea
Nov 07 02:43:56 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:56 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:56 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea is being set with open permissions: ugo+rw
Nov 07 02:43:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:56 devstack sudo[100604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea
Nov 07 02:43:56 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:56 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea" returned: 0 in 0.339s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.776s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:56 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3c8a792a-9709-47d2-afa9-e307f1de3207 tempest-VolumesSnapshotListTestJSON-1881599792 None] Create snapshot completed successfully
Nov 07 02:43:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] Creating offline snapshot d44e9b78-5d96-4dfe-9392-f5fa1b221985 of volume e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:43:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[801bf47d-d5b0-4c29-8536-a12494060a9b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:57 devstack sudo[100608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea
Nov 07 02:43:57 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:58 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea" returned: 0 in 0.468s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:43:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:58 devstack sudo[100624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985 1G
Nov 07 02:43:58 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:58 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985 1G" returned: 0 in 0.688s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:58 devstack sudo[100647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985
Nov 07 02:43:58 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:59 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985" returned: 0 in 0.317s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:59 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985 is being set with open permissions: ugo+rw
Nov 07 02:43:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:59 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985
Nov 07 02:43:59 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:59 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985" returned: 0 in 0.249s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f07a3263-6401-432a-bd01-9d973a932685 tempest-VolumesSnapshotListTestJSON-1881599792 None] Create snapshot completed successfully
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "cinder-d44e9b78-5d96-4dfe-9392-f5fa1b221985-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-d44e9b78-5d96-4dfe-9392-f5fa1b221985-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "cinder-quobyte-d44e9b78-5d96-4dfe-9392-f5fa1b221985" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-d44e9b78-5d96-4dfe-9392-f5fa1b221985" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Deleting offline snapshot d44e9b78-5d96-4dfe-9392-f5fa1b221985 of volume e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] snapshot_file for this snap is: volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f365ac-9021-46c6-a5e0-a5f6c4a9dd1b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:00 devstack sudo[100657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985
Nov 07 02:44:00 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:00 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985" returned: 0 in 0.372s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:44:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e93a0c-83b8-4e15-8c0e-cf79a44cb7c8]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:01 devstack sudo[100662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea
Nov 07 02:44:01 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:01 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea" returned: 0 in 0.374s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:44:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:01 devstack sudo[100667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985
Nov 07 02:44:01 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:01 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985" returned: 0 in 0.474s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:01 devstack sudo[100673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985
Nov 07 02:44:01 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:02 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.d44e9b78-5d96-4dfe-9392-f5fa1b221985" returned: 0 in 0.257s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-d44e9b78-5d96-4dfe-9392-f5fa1b221985" released by "_delete_snapshot" :: held 1.594s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" released by "delete_snapshot" :: held 1.622s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Created reservations ['78f58ad3-dff9-400b-8e89-78cecf5cd4ae', '32b39704-fdc7-4bf9-a2c7-31ba9b86f1b6', '8941e3c9-96c7-4b41-b042-b24eb0cbaa9a', 'f53c7169-feef-45eb-b0b1-1869341ac497'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Delete snapshot completed successfully.
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ddf7c3a6-e04b-4464-b7f4-16b1cf7688e8 tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-d44e9b78-5d96-4dfe-9392-f5fa1b221985-delete_snapshot" released by "delete_snapshot" :: held 1.762s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "cinder-3c660dc2-6a70-4c00-b965-f5582d15d5ea-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-3c660dc2-6a70-4c00-b965-f5582d15d5ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "cinder-quobyte-3c660dc2-6a70-4c00-b965-f5582d15d5ea" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-3c660dc2-6a70-4c00-b965-f5582d15d5ea" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Deleting offline snapshot 3c660dc2-6a70-4c00-b965-f5582d15d5ea of volume e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] snapshot_file for this snap is: volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa23cf9b-2314-49c6-8700-617de085fe48]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:02 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea
Nov 07 02:44:02 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:03 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea" returned: 0 in 0.395s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:44:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ebd8a8-2874-47a8-85f0-4059590563f1]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:03 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b
Nov 07 02:44:03 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:03 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b" returned: 0 in 0.418s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:44:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:03 devstack sudo[100686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea
Nov 07 02:44:03 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:04 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea" returned: 0 in 0.584s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:04 devstack sudo[100693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea
Nov 07 02:44:04 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:04 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.3c660dc2-6a70-4c00-b965-f5582d15d5ea" returned: 0 in 0.276s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-3c660dc2-6a70-4c00-b965-f5582d15d5ea" released by "_delete_snapshot" :: held 1.811s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" released by "delete_snapshot" :: held 1.835s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Created reservations ['2e2d7542-3a19-41d0-8b30-d705af22f1f7', 'ac378be0-41a7-4ce4-9654-a051289a8643', '88bc0ebd-e512-4dc4-abca-87edc0af7072', 'a243aab1-69b1-4b75-ac4e-dcb2cc9d73ad'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Delete snapshot completed successfully.
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3e2356d9-d7da-4eb6-992c-2ac25b08a9ba tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-3c660dc2-6a70-4c00-b965-f5582d15d5ea-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "cinder-dc3bfaed-f1cf-4197-a6d1-e527e8579f9b-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-dc3bfaed-f1cf-4197-a6d1-e527e8579f9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "cinder-quobyte-dc3bfaed-f1cf-4197-a6d1-e527e8579f9b" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-dc3bfaed-f1cf-4197-a6d1-e527e8579f9b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Deleting offline snapshot dc3bfaed-f1cf-4197-a6d1-e527e8579f9b of volume e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:44:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] snapshot_file for this snap is: volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:44:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f5e0ae-429f-4053-b95d-f125c20e05fc]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:05 devstack sudo[100696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b
Nov 07 02:44:05 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:05 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:44:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d49dd3f-eee3-4711-9e32-cd4c10ee8d27]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:05 devstack sudo[100702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09
Nov 07 02:44:05 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:05 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09" returned: 0 in 0.388s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:05 devstack sudo[100707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b
Nov 07 02:44:05 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:06 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b" returned: 0 in 0.594s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:06 devstack sudo[100712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b
Nov 07 02:44:06 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:06 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09.dc3bfaed-f1cf-4197-a6d1-e527e8579f9b" returned: 0 in 0.259s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-dc3bfaed-f1cf-4197-a6d1-e527e8579f9b" released by "_delete_snapshot" :: held 1.773s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" released by "delete_snapshot" :: held 1.815s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:06 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Created reservations ['fcfd6f54-11a0-4748-9c9a-44d8ed2b31e3', '57fe5b66-315e-4999-aa60-db3a6e1452ab', 'ddb8aee3-0935-483f-938c-b5e83bb61229', 'dbbd75fb-c4a6-4cf1-8a9d-1090d5970c4b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Delete snapshot completed successfully.
Nov 07 02:44:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b651f3b0-14cb-4864-a1d9-d072b3e2669d tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-dc3bfaed-f1cf-4197-a6d1-e527e8579f9b-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "cinder-e11149c0-0a86-46ee-a7f9-5fb19f179d09-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-e11149c0-0a86-46ee-a7f9-5fb19f179d09-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd8ae27-cd27-4941-817a-008fc2cc3f58]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:07 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09
Nov 07 02:44:07 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:07 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09" returned: 0 in 0.370s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:07 devstack sudo[100721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09
Nov 07 02:44:07 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:07 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e11149c0-0a86-46ee-a7f9-5fb19f179d09" returned: 0 in 0.258s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-quobyte-e11149c0-0a86-46ee-a7f9-5fb19f179d09" released by "delete_volume" :: held 0.714s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:08 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Created reservations ['a59a6bcd-1fca-44ab-bfaf-8e2bb1b2974c', '4cb63f5b-8b17-4423-ba06-e014f9b8f747', 'cfbad9ea-d3ff-44af-b65d-cda6613c2439', '90040804-4bee-4e13-95d8-a3de00e7dce7'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:08 devstack sudo[100725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:44:08 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:08 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:08 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Deleted volume successfully.
Nov 07 02:44:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff800411-3229-4f0c-a688-286a78d54dee tempest-VolumesSnapshotListTestJSON-1881599792 None] Lock "cinder-e11149c0-0a86-46ee-a7f9-5fb19f179d09-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-c10ab94e-30d2-4294-8865-b81c079a5e2d req-089afe38-3049-4015-a714-8a57e1db2b20 tempest-AttachVolumeNegativeTest-1898104544 None] Terminate volume connection completed successfully.
Nov 07 02:44:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-c10ab94e-30d2-4294-8865-b81c079a5e2d req-089afe38-3049-4015-a714-8a57e1db2b20 tempest-AttachVolumeNegativeTest-1898104544 None] Deleting attachment 71071080-2d48-44c9-9b46-e5a7d5935211. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Flow 'volume_create_manager' (f3e4c0a6-15f6-44b8-9c64-7985dd6e22c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68304692-8835-4553-8122-ac4d14273edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68304692-8835-4553-8122-ac4d14273edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1086697920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4598a512-9ab3-411f-b7b1-72168028e618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf4d5125b1a246029592509508e1bf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:18Z,use_quota=True,user_id='f81f013bcafd495d9c6cc15429416287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6940cd6-adf6-4a7f-a16b-9a0c60b71ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6940cd6-adf6-4a7f-a16b-9a0c60b71ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d86ca71-388e-4c76-bbbd-f981ea210acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d86ca71-388e-4c76-bbbd-f981ea210acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4598a512-9ab3-411f-b7b1-72168028e618', 'volume_name': 'volume-4598a512-9ab3-411f-b7b1-72168028e618', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89620a90-5a9a-4ff7-b5da-9571ec87325d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89620a90-5a9a-4ff7-b5da-9571ec87325d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce996b83-0937-4b0e-bc78-52dc1bd78b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:18 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Volume 4598a512-9ab3-411f-b7b1-72168028e618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4598a512-9ab3-411f-b7b1-72168028e618', 'volume_size': 1}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1086697920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4598a512-9ab3-411f-b7b1-72168028e618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf4d5125b1a246029592509508e1bf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:18Z,use_quota=True,user_id='f81f013bcafd495d9c6cc15429416287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Creating volume 4598a512-9ab3-411f-b7b1-72168028e618 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:44:18 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:44:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:18 devstack sudo[100784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 1073741824
Nov 07 02:44:18 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:19 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 1073741824" returned: 0 in 0.593s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:19 devstack sudo[100792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618
Nov 07 02:44:19 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:19 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618" returned: 0 in 0.271s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:44:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce996b83-0937-4b0e-bc78-52dc1bd78b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4598a512-9ab3-411f-b7b1-72168028e618', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf6603b-5452-460f-b1d3-743db28d39ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:19 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Volume volume-4598a512-9ab3-411f-b7b1-72168028e618 (4598a512-9ab3-411f-b7b1-72168028e618): created successfully
Nov 07 02:44:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf6603b-5452-460f-b1d3-743db28d39ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:19 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Flow 'volume_create_manager' (f3e4c0a6-15f6-44b8-9c64-7985dd6e22c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-119b234b-1040-46a9-b6ae-2f7809ae987b tempest-TestStampPattern-174183251 None] Created volume successfully.
Nov 07 02:44:29 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=70,cinder:INSERT=28,cinder:SELECT=58,cinder:DELETE=6 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:44:29 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=73,cinder:UPDATE=69,cinder:DELETE=6,cinder:INSERT=18 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:44:46 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:44:46 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:53 devstack sudo[101180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:44:53 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:53 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.317s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:44:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:44:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-79ac3591-b54f-4693-8911-078d5d58bd83 req-5083b9ba-4fa9-455a-bdc2-f5913678c1b8 tempest-TestStampPattern-174183251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-79ac3591-b54f-4693-8911-078d5d58bd83 req-5083b9ba-4fa9-455a-bdc2-f5913678c1b8 tempest-TestStampPattern-174183251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-79ac3591-b54f-4693-8911-078d5d58bd83 req-5083b9ba-4fa9-455a-bdc2-f5913678c1b8 tempest-TestStampPattern-174183251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-79ac3591-b54f-4693-8911-078d5d58bd83 req-5083b9ba-4fa9-455a-bdc2-f5913678c1b8 tempest-TestStampPattern-174183251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-4598a512-9ab3-411f-b7b1-72168028e618', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4849df82-07ba-453f-84ea-615ae5be75b0', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:44:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-79ac3591-b54f-4693-8911-078d5d58bd83 req-5083b9ba-4fa9-455a-bdc2-f5913678c1b8 tempest-TestStampPattern-174183251 None] attachment_update completed successfully.
Nov 07 02:45:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-727d0898-0fa1-4977-a9e6-5ce186ca565b req-f843f116-1147-4ef0-8d4f-f59e3e0d18f9 tempest-TestStampPattern-174183251 None] Terminate volume connection completed successfully.
Nov 07 02:45:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-727d0898-0fa1-4977-a9e6-5ce186ca565b req-f843f116-1147-4ef0-8d4f-f59e3e0d18f9 tempest-TestStampPattern-174183251 None] Deleting attachment 4849df82-07ba-453f-84ea-615ae5be75b0. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:45:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] Creating offline snapshot 17948507-89b4-44ac-8a07-eb2c8768aea6 of volume 4598a512-9ab3-411f-b7b1-72168028e618 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:45:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ea07e2-9fc0-4608-bdcb-b1e94c4c3e6e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:01 devstack sudo[101665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618
Nov 07 02:45:01 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:01 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618" returned: 0 in 0.387s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:02 devstack sudo[101673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6 1G
Nov 07 02:45:02 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:02 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6 1G" returned: 0 in 0.408s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4598a512-9ab3-411f-b7b1-72168028e618 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:02 devstack sudo[101679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4598a512-9ab3-411f-b7b1-72168028e618 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6
Nov 07 02:45:02 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:02 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4598a512-9ab3-411f-b7b1-72168028e618 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6" returned: 0 in 0.317s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:02 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6 is being set with open permissions: ugo+rw
Nov 07 02:45:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:02 devstack sudo[101684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6
Nov 07 02:45:02 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:02 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6" returned: 0 in 0.253s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:03 devstack sudo[101687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.info
Nov 07 02:45:03 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:03 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.info" returned: 0 in 0.270s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:03 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.info is being set with open permissions: ugo+rw
Nov 07 02:45:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:03 devstack sudo[101690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.info
Nov 07 02:45:03 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:03 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.info" returned: 0 in 0.255s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4c71f3e3-e330-491e-a4ce-2f93bc93fc9c tempest-TestStampPattern-174183251 None] Create snapshot completed successfully
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Flow 'volume_create_manager' (68b4694e-21d2-4d14-8632-f8bff12319c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df03dfa1-edd1-4203-841b-f286b70a2cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df03dfa1-edd1-4203-841b-f286b70a2cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1706880225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287508b8-547b-40e1-89ad-f38330636cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce26d9495504ef897fa9c8322e90a8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:05Z,use_quota=True,user_id='b7016772c7fd4bddb836df39fe0b72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcdd664-9838-4a62-8d0b-e11e243c9f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcdd664-9838-4a62-8d0b-e11e243c9f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76e10c7-4622-4edc-a790-16fa8a1d9979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76e10c7-4622-4edc-a790-16fa8a1d9979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287508b8-547b-40e1-89ad-f38330636cc3', 'volume_name': 'volume-287508b8-547b-40e1-89ad-f38330636cc3', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a669f99-4365-42a9-bde7-8a89e7566224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a669f99-4365-42a9-bde7-8a89e7566224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed77f3ea-6043-4f7b-8640-30d62c634d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:05 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Volume 287508b8-547b-40e1-89ad-f38330636cc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287508b8-547b-40e1-89ad-f38330636cc3', 'volume_size': 1}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1706880225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287508b8-547b-40e1-89ad-f38330636cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce26d9495504ef897fa9c8322e90a8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:05Z,use_quota=True,user_id='b7016772c7fd4bddb836df39fe0b72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Creating volume 287508b8-547b-40e1-89ad-f38330636cc3 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:05 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:05 devstack sudo[101710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3 1073741824
Nov 07 02:45:05 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:05 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3 1073741824" returned: 0 in 0.513s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:05 devstack sudo[101716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3
Nov 07 02:45:05 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:06 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed77f3ea-6043-4f7b-8640-30d62c634d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287508b8-547b-40e1-89ad-f38330636cc3', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e663ae-52b6-4ef2-85c8-6fd84101d7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:06 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Volume volume-287508b8-547b-40e1-89ad-f38330636cc3 (287508b8-547b-40e1-89ad-f38330636cc3): created successfully
Nov 07 02:45:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e663ae-52b6-4ef2-85c8-6fd84101d7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Flow 'volume_create_manager' (68b4694e-21d2-4d14-8632-f8bff12319c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0ba16bc1-93c0-45ae-9a98-c9c0aad38337 tempest-AttachVolumeNegativeTest-1898104544 None] Created volume successfully.
Nov 07 02:45:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-9740f553-8ef3-4af3-8872-3f3f72df0ca5 req-e93e1914-6c96-47b0-bbf0-930b8fbfcacd tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-9740f553-8ef3-4af3-8872-3f3f72df0ca5 req-e93e1914-6c96-47b0-bbf0-930b8fbfcacd tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-9740f553-8ef3-4af3-8872-3f3f72df0ca5 req-e93e1914-6c96-47b0-bbf0-930b8fbfcacd tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-9740f553-8ef3-4af3-8872-3f3f72df0ca5 req-e93e1914-6c96-47b0-bbf0-930b8fbfcacd tempest-AttachVolumeNegativeTest-1898104544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-287508b8-547b-40e1-89ad-f38330636cc3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3421767e-a416-4cc5-98c5-9b119703d0e5', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:45:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-9740f553-8ef3-4af3-8872-3f3f72df0ca5 req-e93e1914-6c96-47b0-bbf0-930b8fbfcacd tempest-AttachVolumeNegativeTest-1898104544 None] attachment_update completed successfully.
Nov 07 02:45:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-12262629-2014-4443-a78b-09fcd4a68d67 req-a7f92d61-4983-441d-9958-a18c6188d9f9 tempest-AttachVolumeNegativeTest-1898104544 None] Terminate volume connection completed successfully.
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-12262629-2014-4443-a78b-09fcd4a68d67 req-a7f92d61-4983-441d-9958-a18c6188d9f9 tempest-AttachVolumeNegativeTest-1898104544 None] Deleting attachment 3421767e-a416-4cc5-98c5-9b119703d0e5. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Flow 'volume_create_manager' (7d237214-1a66-426d-ae0d-9fdc07e7e641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d69108-39ec-4a8c-a99f-f4808c9ee901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d69108-39ec-4a8c-a99f-f4808c9ee901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-48472056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3331f022-6154-423d-8fa4-3de38000d7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf4d5125b1a246029592509508e1bf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17948507-89b4-44ac-8a07-eb2c8768aea6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:11Z,use_quota=True,user_id='f81f013bcafd495d9c6cc15429416287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43345f6-ed62-4ba1-86fd-797ebcef34c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43345f6-ed62-4ba1-86fd-797ebcef34c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cae32c8-9d41-465e-b5f3-86988a7ac48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cae32c8-9d41-465e-b5f3-86988a7ac48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3331f022-6154-423d-8fa4-3de38000d7c4', 'volume_name': 'volume-3331f022-6154-423d-8fa4-3de38000d7c4', 'volume_size': 1, 'snapshot_id': '17948507-89b4-44ac-8a07-eb2c8768aea6'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0007eec-8966-4b0c-9fe9-cbecc4740d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0007eec-8966-4b0c-9fe9-cbecc4740d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040e37d3-7db7-4d44-ac2c-9f792e5b0d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Volume 3331f022-6154-423d-8fa4-3de38000d7c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3331f022-6154-423d-8fa4-3de38000d7c4', 'volume_size': 1, 'snapshot_id': '17948507-89b4-44ac-8a07-eb2c8768aea6'}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Acquiring lock "cinder-quobyte-17948507-89b4-44ac-8a07-eb2c8768aea6-3331f022-6154-423d-8fa4-3de38000d7c4" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-17948507-89b4-44ac-8a07-eb2c8768aea6-3331f022-6154-423d-8fa4-3de38000d7c4" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Creating volume 3331f022-6154-423d-8fa4-3de38000d7c4 from snapshot 17948507-89b4-44ac-8a07-eb2c8768aea6 {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Acquiring lock "cinder-quobyte-3331f022-6154-423d-8fa4-3de38000d7c4" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-3331f022-6154-423d-8fa4-3de38000d7c4" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] snapshot: 17948507-89b4-44ac-8a07-eb2c8768aea6, volume: 3331f022-6154-423d-8fa4-3de38000d7c4,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[93364162-459f-449b-af96-ca119831f30a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:11 devstack sudo[102198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6
Nov 07 02:45:11 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:12 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6" returned: 0 in 0.462s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4598a512-9ab3-411f-b7b1-72168028e618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:45:12 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb94d95d-2de1-4a10-970d-553b10be13c8]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:12 devstack sudo[102203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618
Nov 07 02:45:12 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:12 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618" returned: 0 in 0.669s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:45:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:45:12 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:45:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:12 devstack sudo[102233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4
Nov 07 02:45:12 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Flow 'volume_create_manager' (e99cd5c7-32c4-4da3-bd96-c683fa59e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95089f13-fa6d-4756-a714-5933ccacff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95089f13-fa6d-4756-a714-5933ccacff29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-362671811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d202e8a-71fb-4138-98ce-449b741ecefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb65189034e4c2a9ecc2445d61311dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:14Z,use_quota=True,user_id='1351a5197d284a9c9101eb2247cdfed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6859f5b8-2d7e-4e69-8a81-49d238a7efae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6859f5b8-2d7e-4e69-8a81-49d238a7efae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d8e03f-1d07-4a3a-ac43-b52567738c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d8e03f-1d07-4a3a-ac43-b52567738c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d202e8a-71fb-4138-98ce-449b741ecefd', 'volume_name': 'volume-9d202e8a-71fb-4138-98ce-449b741ecefd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fc7241-52c1-427e-a362-e225f00d689d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fc7241-52c1-427e-a362-e225f00d689d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41264c41-8790-4033-bfd8-9ef3456ff8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:14 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Volume 9d202e8a-71fb-4138-98ce-449b741ecefd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d202e8a-71fb-4138-98ce-449b741ecefd', 'volume_size': 1}
Nov 07 02:45:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:23 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4" returned: 0 in 10.388s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618, size 1024.00 MB, duration 10.39 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:45:23 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Converted 1024.00 MB image at 98.55 MB/s
Nov 07 02:45:23 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4 is being set with open permissions: ugo+rw
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:23 devstack sudo[102319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4
Nov 07 02:45:23 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:23 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4" returned: 0 in 0.344s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-3331f022-6154-423d-8fa4-3de38000d7c4" released by "_copy_volume_from_snapshot" :: held 11.976s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-17948507-89b4-44ac-8a07-eb2c8768aea6-3331f022-6154-423d-8fa4-3de38000d7c4" released by "_create_volume_from_snapshot" :: held 12.069s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.084s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.188s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-362671811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d202e8a-71fb-4138-98ce-449b741ecefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb65189034e4c2a9ecc2445d61311dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:14Z,use_quota=True,user_id='1351a5197d284a9c9101eb2247cdfed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Creating volume 9d202e8a-71fb-4138-98ce-449b741ecefd {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:23 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:23 devstack sudo[102322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd 1073741824
Nov 07 02:45:23 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040e37d3-7db7-4d44-ac2c-9f792e5b0d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3331f022-6154-423d-8fa4-3de38000d7c4', 'volume_size': 1, 'snapshot_id': '17948507-89b4-44ac-8a07-eb2c8768aea6'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6663fb3-738d-4a78-887e-5cf5c2b26943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:23 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Volume volume-3331f022-6154-423d-8fa4-3de38000d7c4 (3331f022-6154-423d-8fa4-3de38000d7c4): created successfully
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6663fb3-738d-4a78-887e-5cf5c2b26943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Flow 'volume_create_manager' (7d237214-1a66-426d-ae0d-9fdc07e7e641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3115b0fe-2c66-44d6-b0b2-cf9ae05d860b tempest-TestStampPattern-174183251 None] Created volume successfully.
Nov 07 02:45:24 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd 1073741824" returned: 0 in 0.727s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:24 devstack sudo[102331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd
Nov 07 02:45:24 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:24 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd" returned: 0 in 0.283s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41264c41-8790-4033-bfd8-9ef3456ff8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d202e8a-71fb-4138-98ce-449b741ecefd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd133e0-65d5-4c55-9b7d-e1866f117611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Volume volume-9d202e8a-71fb-4138-98ce-449b741ecefd (9d202e8a-71fb-4138-98ce-449b741ecefd): created successfully
Nov 07 02:45:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd133e0-65d5-4c55-9b7d-e1866f117611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Flow 'volume_create_manager' (e99cd5c7-32c4-4da3-bd96-c683fa59e444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e260fdc0-1336-44a3-aa7c-8556afec2771 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Created volume successfully.
Nov 07 02:45:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4bb70235-32c0-4c11-8caa-df118cea80a4 req-3fe823e9-d642-4736-8253-502cabb70d54 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4bb70235-32c0-4c11-8caa-df118cea80a4 req-3fe823e9-d642-4736-8253-502cabb70d54 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-4bb70235-32c0-4c11-8caa-df118cea80a4 req-3fe823e9-d642-4736-8253-502cabb70d54 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-4bb70235-32c0-4c11-8caa-df118cea80a4 req-3fe823e9-d642-4736-8253-502cabb70d54 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-9d202e8a-71fb-4138-98ce-449b741ecefd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5697ba0c-b96f-4192-99bf-7ecf13fcf6f4', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:45:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-4bb70235-32c0-4c11-8caa-df118cea80a4 req-3fe823e9-d642-4736-8253-502cabb70d54 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] attachment_update completed successfully.
Nov 07 02:45:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-5d337ee8-20aa-4475-95e3-cf4cdb654110 req-0f077b9d-d482-4db4-a746-cc827d24a6d0 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Terminate volume connection completed successfully.
Nov 07 02:45:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-5d337ee8-20aa-4475-95e3-cf4cdb654110 req-0f077b9d-d482-4db4-a746-cc827d24a6d0 tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Deleting attachment 5697ba0c-b96f-4192-99bf-7ecf13fcf6f4. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:45:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Acquiring lock "cinder-9d202e8a-71fb-4138-98ce-449b741ecefd-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "cinder-9d202e8a-71fb-4138-98ce-449b741ecefd-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Acquiring lock "cinder-quobyte-9d202e8a-71fb-4138-98ce-449b741ecefd" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "cinder-quobyte-9d202e8a-71fb-4138-98ce-449b741ecefd" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:32 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fee306-9aa4-44f8-a670-92863b9082aa]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:32 devstack sudo[102868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd
Nov 07 02:45:32 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:32 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd" returned: 0 in 0.736s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:33 devstack sudo[102883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd
Nov 07 02:45:33 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:33 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9d202e8a-71fb-4138-98ce-449b741ecefd" returned: 0 in 0.419s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "cinder-quobyte-9d202e8a-71fb-4138-98ce-449b741ecefd" released by "delete_volume" :: held 1.282s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:33 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Created reservations ['5120575c-662c-433e-9750-0f3b1f0a754c', 'd1347e31-3a5b-433e-a5d0-5c38f876b141', 'db67b73c-f22e-4b24-8889-3f2ca7e15a13', '7002f74b-243a-4496-a4d9-e871c2446f69'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:45:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:33 devstack sudo[102888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:45:33 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:33 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.336s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:33 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:45:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Deleted volume successfully.
Nov 07 02:45:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-19862af7-97e9-451c-b220-d82bf3292f2c tempest-TestServerVolumeAttachScenarioOldVersion-232145510 None] Lock "cinder-9d202e8a-71fb-4138-98ce-449b741ecefd-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:43 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=36,cinder:UPDATE=26,cinder:INSERT=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:45:43 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=41,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=5 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:53 devstack sudo[103024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:45:53 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Flow 'volume_create_manager' (4d1fe3ca-1963-4478-9949-d8a92dbfbcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9430664e-2d62-49ef-802d-fff7c989fa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9430664e-2d62-49ef-802d-fff7c989fa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-802008149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e8b8a2-1e65-47ec-8343-7fe712e76caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93cb0a017704df99710a9ebd20d6f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:54Z,use_quota=True,user_id='2d04e69a696f430882afe07f1bd7f16b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c67b0c-261c-4218-970b-ff48a9dea80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c67b0c-261c-4218-970b-ff48a9dea80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b76b5a-58fb-4d12-9837-256f42d76a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b76b5a-58fb-4d12-9837-256f42d76a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e8b8a2-1e65-47ec-8343-7fe712e76caa', 'volume_name': 'volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb566d94-b7c7-46da-bba1-e839e84b9c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb566d94-b7c7-46da-bba1-e839e84b9c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3673368d-0cbd-4fea-9ef6-a8ccfc5ce730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Volume 17e8b8a2-1e65-47ec-8343-7fe712e76caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa', 'volume_size': 1}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-802008149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e8b8a2-1e65-47ec-8343-7fe712e76caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93cb0a017704df99710a9ebd20d6f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:54Z,use_quota=True,user_id='2d04e69a696f430882afe07f1bd7f16b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Creating volume 17e8b8a2-1e65-47ec-8343-7fe712e76caa {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:53 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:53 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.438s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:45:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:45:53 devstack sudo[103027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa 1073741824
Nov 07 02:45:53 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-2a48d924-cc03-4fc0-9fb0-839d948fda9a req-76789ac0-715c-46a6-9074-8f56c39ad7eb tempest-TestStampPattern-174183251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:54 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa 1073741824" returned: 0 in 0.490s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:54 devstack sudo[103041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa
Nov 07 02:45:54 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:54 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa" returned: 0 in 0.259s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-2a48d924-cc03-4fc0-9fb0-839d948fda9a req-76789ac0-715c-46a6-9074-8f56c39ad7eb tempest-TestStampPattern-174183251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.435s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-2a48d924-cc03-4fc0-9fb0-839d948fda9a req-76789ac0-715c-46a6-9074-8f56c39ad7eb tempest-TestStampPattern-174183251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3673368d-0cbd-4fea-9ef6-a8ccfc5ce730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d740126d-86e7-46b9-836c-134586764d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:54 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Volume volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa (17e8b8a2-1e65-47ec-8343-7fe712e76caa): created successfully
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d740126d-86e7-46b9-836c-134586764d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Flow 'volume_create_manager' (4d1fe3ca-1963-4478-9949-d8a92dbfbcb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-897f41d8-889c-46b3-be30-ba60909f82e9 tempest-VolumeDependencyTests-835911350 None] Created volume successfully.
Nov 07 02:45:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-2a48d924-cc03-4fc0-9fb0-839d948fda9a req-76789ac0-715c-46a6-9074-8f56c39ad7eb tempest-TestStampPattern-174183251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-3331f022-6154-423d-8fa4-3de38000d7c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '998ded88-0d94-4af6-a5ff-0f5fec118131', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:45:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-2a48d924-cc03-4fc0-9fb0-839d948fda9a req-76789ac0-715c-46a6-9074-8f56c39ad7eb tempest-TestStampPattern-174183251 None] attachment_update completed successfully.
Nov 07 02:45:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] Creating offline snapshot 7dd313a1-08fc-404f-a22e-6514c80f931d of volume 17e8b8a2-1e65-47ec-8343-7fe712e76caa {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:45:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f98c1d-d4ad-435a-a6f6-48627c5f414c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:56 devstack sudo[103459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa
Nov 07 02:45:56 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:56 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa" returned: 0 in 0.363s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:56 devstack sudo[103468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d 1G
Nov 07 02:45:56 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:56 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d 1G" returned: 0 in 0.486s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:56 devstack sudo[103486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d
Nov 07 02:45:56 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Flow 'volume_create_manager' (afeb7c5a-efac-49a5-a588-651a84e825ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177621d7-10bc-4d72-8b06-dad274ae4c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177621d7-10bc-4d72-8b06-dad274ae4c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-713932271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238617f1-216d-47ef-a0bd-e4298ad83b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce26d9495504ef897fa9c8322e90a8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:57Z,use_quota=True,user_id='b7016772c7fd4bddb836df39fe0b72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7299c1-a40a-447a-8e12-948cea7fcbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7299c1-a40a-447a-8e12-948cea7fcbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8e174e-ab94-4f09-8c57-df7b4f942f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8e174e-ab94-4f09-8c57-df7b4f942f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '238617f1-216d-47ef-a0bd-e4298ad83b76', 'volume_name': 'volume-238617f1-216d-47ef-a0bd-e4298ad83b76', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:57 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d75243b-314b-41c5-9a18-ad78b319222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d75243b-314b-41c5-9a18-ad78b319222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb41dd4f-11a9-488e-8dcc-b071259d3735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Volume 238617f1-216d-47ef-a0bd-e4298ad83b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-238617f1-216d-47ef-a0bd-e4298ad83b76', 'volume_size': 1}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d" returned: 0 in 0.401s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:57 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d is being set with open permissions: ugo+rw
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:57 devstack sudo[103493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d
Nov 07 02:45:57 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:57 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d" returned: 0 in 0.253s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:57 devstack sudo[103497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.info
Nov 07 02:45:57 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-00ac7eb7-6211-4ae8-a571-4674ee9f09f1 req-d026e9c8-f257-4b22-96d9-08c9933b9d4a tempest-TestStampPattern-174183251 None] Terminate volume connection completed successfully.
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-00ac7eb7-6211-4ae8-a571-4674ee9f09f1 req-d026e9c8-f257-4b22-96d9-08c9933b9d4a tempest-TestStampPattern-174183251 None] Deleting attachment 998ded88-0d94-4af6-a5ff-0f5fec118131. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:45:57 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.info" returned: 0 in 0.264s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:57 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.info is being set with open permissions: ugo+rw
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:57 devstack sudo[103526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.info
Nov 07 02:45:57 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:57 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.info" returned: 0 in 0.288s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.139s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.866s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-713932271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238617f1-216d-47ef-a0bd-e4298ad83b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce26d9495504ef897fa9c8322e90a8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:57Z,use_quota=True,user_id='b7016772c7fd4bddb836df39fe0b72bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Creating volume 238617f1-216d-47ef-a0bd-e4298ad83b76 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:58 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:58 devstack sudo[103530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76 1073741824
Nov 07 02:45:58 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1a4c4ba7-5802-40b9-b5d0-2bb194cc6d2a tempest-VolumeDependencyTests-835911350 None] Create snapshot completed successfully
Nov 07 02:45:58 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76 1073741824" returned: 0 in 0.444s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:58 devstack sudo[103536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76
Nov 07 02:45:58 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:58 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76" returned: 0 in 0.249s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb41dd4f-11a9-488e-8dcc-b071259d3735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-238617f1-216d-47ef-a0bd-e4298ad83b76', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab290e2-03d5-498f-a7fd-b7d474f32200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Volume volume-238617f1-216d-47ef-a0bd-e4298ad83b76 (238617f1-216d-47ef-a0bd-e4298ad83b76): created successfully
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab290e2-03d5-498f-a7fd-b7d474f32200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Flow 'volume_create_manager' (afeb7c5a-efac-49a5-a588-651a84e825ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6fce62d3-cd8e-4eb2-b4c7-e7c4fd1caed2 tempest-AttachVolumeNegativeTest-1898104544 None] Created volume successfully.
Nov 07 02:45:59 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Flow 'volume_create_manager' (9b97019e-2d96-4c3f-a5ce-3cfc66056eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdba711-f611-4b74-be8e-639ead324a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdba711-f611-4b74-be8e-639ead324a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-600149162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e87239f-6dc9-4f42-bba7-c9717f9092ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93cb0a017704df99710a9ebd20d6f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7dd313a1-08fc-404f-a22e-6514c80f931d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:00Z,use_quota=True,user_id='2d04e69a696f430882afe07f1bd7f16b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b856726-8b16-4596-9678-70370736e893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b856726-8b16-4596-9678-70370736e893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df5d16f-0a68-4ab2-9049-0e484e2683c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df5d16f-0a68-4ab2-9049-0e484e2683c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4e87239f-6dc9-4f42-bba7-c9717f9092ef', 'volume_name': 'volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef', 'volume_size': 1, 'snapshot_id': '7dd313a1-08fc-404f-a22e-6514c80f931d'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad2a07b-839a-4121-8a2e-dff3b2056473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad2a07b-839a-4121-8a2e-dff3b2056473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e047a08-d736-4678-acbb-45f612ed0c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:00 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Volume 4e87239f-6dc9-4f42-bba7-c9717f9092ef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef', 'volume_size': 1, 'snapshot_id': '7dd313a1-08fc-404f-a22e-6514c80f931d'}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Acquiring lock "cinder-quobyte-7dd313a1-08fc-404f-a22e-6514c80f931d-4e87239f-6dc9-4f42-bba7-c9717f9092ef" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-7dd313a1-08fc-404f-a22e-6514c80f931d-4e87239f-6dc9-4f42-bba7-c9717f9092ef" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Creating volume 4e87239f-6dc9-4f42-bba7-c9717f9092ef from snapshot 7dd313a1-08fc-404f-a22e-6514c80f931d {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Acquiring lock "cinder-quobyte-4e87239f-6dc9-4f42-bba7-c9717f9092ef" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-4e87239f-6dc9-4f42-bba7-c9717f9092ef" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] snapshot: 7dd313a1-08fc-404f-a22e-6514c80f931d, volume: 4e87239f-6dc9-4f42-bba7-c9717f9092ef,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[921bf065-0575-4ad6-a329-cf84cddec920]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:00 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d
Nov 07 02:46:00 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-7fc2e2b0-2f57-4073-bfa8-9d670bba31dc req-dc1ee67b-54ad-42ed-8426-0b726def06d8 tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:00 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d" returned: 0 in 0.544s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc54543-9860-438f-9c85-2b2c9d1b7a15]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:00 devstack sudo[103581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa
Nov 07 02:46:00 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:01 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa" returned: 0 in 0.448s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:46:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:46:01 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:46:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:01 devstack sudo[103587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef
Nov 07 02:46:01 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Acquiring lock "cinder-3331f022-6154-423d-8fa4-3de38000d7c4-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Lock "cinder-3331f022-6154-423d-8fa4-3de38000d7c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Acquiring lock "cinder-quobyte-3331f022-6154-423d-8fa4-3de38000d7c4" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-3331f022-6154-423d-8fa4-3de38000d7c4" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[017be0aa-d8d7-40fc-bf08-362bf748cca8]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:02 devstack sudo[103599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4
Nov 07 02:46:02 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:03 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4" returned: 0 in 0.609s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:03 devstack sudo[103605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4
Nov 07 02:46:03 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:03 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3331f022-6154-423d-8fa4-3de38000d7c4" returned: 0 in 0.555s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-3331f022-6154-423d-8fa4-3de38000d7c4" released by "delete_volume" :: held 1.263s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:03 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Created reservations ['29b2cdea-524c-4c25-b145-71be2f087863', '46e7456b-e9de-42f5-a56c-6279557f8aef', '017625b7-5c3f-4f55-9dc4-10420a117819', '1a2fe450-38bf-44a8-ad6c-90e18c892d61'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:04 devstack sudo[103609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:04 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:04 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.389s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:04 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Deleted volume successfully.
Nov 07 02:46:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7edd3eed-22c7-40fe-8b6b-c8a598055433 tempest-TestStampPattern-174183251 None] Lock "cinder-3331f022-6154-423d-8fa4-3de38000d7c4-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Acquiring lock "cinder-17948507-89b4-44ac-8a07-eb2c8768aea6-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Lock "cinder-17948507-89b4-44ac-8a07-eb2c8768aea6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Acquiring lock "cinder-quobyte-4598a512-9ab3-411f-b7b1-72168028e618" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-4598a512-9ab3-411f-b7b1-72168028e618" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Acquiring lock "cinder-quobyte-17948507-89b4-44ac-8a07-eb2c8768aea6" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-17948507-89b4-44ac-8a07-eb2c8768aea6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Deleting offline snapshot 17948507-89b4-44ac-8a07-eb2c8768aea6 of volume 4598a512-9ab3-411f-b7b1-72168028e618 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] snapshot_file for this snap is: volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[821358be-a6a8-4985-84b8-10f7d0b4896b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:05 devstack sudo[103612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6
Nov 07 02:46:05 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:05 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6" returned: 0 in 0.555s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4598a512-9ab3-411f-b7b1-72168028e618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f862701f-578a-4604-9d3e-c3c5f77cda1c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:06 devstack sudo[103617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618
Nov 07 02:46:06 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:06 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618" returned: 0 in 0.851s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:06 devstack sudo[103622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6
Nov 07 02:46:06 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:07 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6" returned: 0 in 0.778s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:07 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6
Nov 07 02:46:07 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:07 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618.17948507-89b4-44ac-8a07-eb2c8768aea6" returned: 0 in 0.420s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-17948507-89b4-44ac-8a07-eb2c8768aea6" released by "_delete_snapshot" :: held 2.822s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-4598a512-9ab3-411f-b7b1-72168028e618" released by "delete_snapshot" :: held 2.866s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Created reservations ['bf5bb79c-74f2-448f-a4ef-18b8e5d93145', '14e337ca-67ca-4c96-82d2-47f62079bdc4', '606eded3-5011-43ae-93bc-775a13f2ea00', '7a689c2a-062d-4a0a-a1da-0bcd1b1141d8'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Delete snapshot completed successfully.
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e349008d-c445-44e0-8e66-40b3b7e95336 tempest-TestStampPattern-174183251 None] Lock "cinder-17948507-89b4-44ac-8a07-eb2c8768aea6-delete_snapshot" released by "delete_snapshot" :: held 3.108s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:08 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef" returned: 0 in 7.240s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa, size 1024.00 MB, duration 7.24 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:46:08 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Converted 1024.00 MB image at 141.39 MB/s
Nov 07 02:46:08 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef is being set with open permissions: ugo+rw
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:08 devstack sudo[103632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef
Nov 07 02:46:08 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:08 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef" returned: 0 in 0.249s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-4e87239f-6dc9-4f42-bba7-c9717f9092ef" released by "_copy_volume_from_snapshot" :: held 8.607s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-7dd313a1-08fc-404f-a22e-6514c80f931d-4e87239f-6dc9-4f42-bba7-c9717f9092ef" released by "_create_volume_from_snapshot" :: held 8.715s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.747s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-7fc2e2b0-2f57-4073-bfa8-9d670bba31dc req-dc1ee67b-54ad-42ed-8426-0b726def06d8 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.293s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-7fc2e2b0-2f57-4073-bfa8-9d670bba31dc req-dc1ee67b-54ad-42ed-8426-0b726def06d8 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e047a08-d736-4678-acbb-45f612ed0c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef', 'volume_size': 1, 'snapshot_id': '7dd313a1-08fc-404f-a22e-6514c80f931d'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755f5ffb-f99d-4d53-a06b-87034885e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Volume volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef (4e87239f-6dc9-4f42-bba7-c9717f9092ef): created successfully
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755f5ffb-f99d-4d53-a06b-87034885e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Flow 'volume_create_manager' (9b97019e-2d96-4c3f-a5ce-3cfc66056eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-7fc2e2b0-2f57-4073-bfa8-9d670bba31dc req-dc1ee67b-54ad-42ed-8426-0b726def06d8 tempest-AttachVolumeNegativeTest-1898104544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-238617f1-216d-47ef-a0bd-e4298ad83b76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '552bc8a1-44bd-425a-9c2c-686a8fec4655', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:46:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fe59c2a2-c98f-44bd-8073-9d6b7864aefd tempest-VolumeDependencyTests-835911350 None] Created volume successfully.
Nov 07 02:46:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-7fc2e2b0-2f57-4073-bfa8-9d670bba31dc req-dc1ee67b-54ad-42ed-8426-0b726def06d8 tempest-AttachVolumeNegativeTest-1898104544 None] attachment_update completed successfully.
Nov 07 02:46:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Acquiring lock "cinder-7dd313a1-08fc-404f-a22e-6514c80f931d-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-7dd313a1-08fc-404f-a22e-6514c80f931d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Acquiring lock "cinder-quobyte-17e8b8a2-1e65-47ec-8343-7fe712e76caa" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-17e8b8a2-1e65-47ec-8343-7fe712e76caa" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Acquiring lock "cinder-quobyte-7dd313a1-08fc-404f-a22e-6514c80f931d" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-7dd313a1-08fc-404f-a22e-6514c80f931d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Deleting offline snapshot 7dd313a1-08fc-404f-a22e-6514c80f931d of volume 17e8b8a2-1e65-47ec-8343-7fe712e76caa {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:46:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] snapshot_file for this snap is: volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:46:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[95790cd0-47ae-4499-a0a0-6a6543e02656]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:09 devstack sudo[104054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d
Nov 07 02:46:09 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:10 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d" returned: 0 in 0.618s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:46:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a36298-94d5-4e95-bd66-6b63317e5529]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:10 devstack sudo[104077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa
Nov 07 02:46:10 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:11 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa" returned: 0 in 0.646s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:11 devstack sudo[104085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d
Nov 07 02:46:11 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-710cd118-674f-4fb9-9f58-c2757e0417c7 req-fd378bf0-50df-4b6a-94da-560fd5f84769 tempest-AttachVolumeNegativeTest-1898104544 None] Terminate volume connection completed successfully.
Nov 07 02:46:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-710cd118-674f-4fb9-9f58-c2757e0417c7 req-fd378bf0-50df-4b6a-94da-560fd5f84769 tempest-AttachVolumeNegativeTest-1898104544 None] Deleting attachment 552bc8a1-44bd-425a-9c2c-686a8fec4655. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:46:11 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d" returned: 0 in 0.506s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:11 devstack sudo[104119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d
Nov 07 02:46:11 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:12 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa.7dd313a1-08fc-404f-a22e-6514c80f931d" returned: 0 in 0.381s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-7dd313a1-08fc-404f-a22e-6514c80f931d" released by "_delete_snapshot" :: held 2.307s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-17e8b8a2-1e65-47ec-8343-7fe712e76caa" released by "delete_snapshot" :: held 2.346s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:12 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Created reservations ['6e5a8686-6446-464f-9e1a-f2f997ae5cc9', 'cd0318ba-eff0-40a6-990b-b07cb99d620c', '17730ca0-7c2b-4e07-92c1-5db3e73fce70', '70d72496-ced0-4d12-bc01-d5889bfd4f0c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Delete snapshot completed successfully.
Nov 07 02:46:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-67ef5cf3-75ac-4365-bcb7-e70175e99526 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-7dd313a1-08fc-404f-a22e-6514c80f931d-delete_snapshot" released by "delete_snapshot" :: held 2.527s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Acquiring lock "cinder-4598a512-9ab3-411f-b7b1-72168028e618-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Lock "cinder-4598a512-9ab3-411f-b7b1-72168028e618-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Acquiring lock "cinder-17e8b8a2-1e65-47ec-8343-7fe712e76caa-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-17e8b8a2-1e65-47ec-8343-7fe712e76caa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Acquiring lock "cinder-quobyte-4598a512-9ab3-411f-b7b1-72168028e618" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-4598a512-9ab3-411f-b7b1-72168028e618" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Acquiring lock "cinder-quobyte-17e8b8a2-1e65-47ec-8343-7fe712e76caa" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdfb295-3d80-4fdf-9897-652cfa19db40]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-17e8b8a2-1e65-47ec-8343-7fe712e76caa" acquired by "delete_volume" :: waited 0.037s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[723adc47-6cbd-44be-8203-c3d83bc0de29]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:13 devstack sudo[104142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618
Nov 07 02:46:13 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:13 devstack sudo[104144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa
Nov 07 02:46:13 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:13 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618" returned: 0 in 0.511s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:13 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:13 devstack sudo[104155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa" returned: 0 in 0.448s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:13 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:13 devstack sudo[104158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa
Nov 07 02:46:13 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:14 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4598a512-9ab3-411f-b7b1-72168028e618" returned: 0 in 0.325s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Lock "cinder-quobyte-4598a512-9ab3-411f-b7b1-72168028e618" released by "delete_volume" :: held 0.932s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:14 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-17e8b8a2-1e65-47ec-8343-7fe712e76caa" returned: 0 in 0.320s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-17e8b8a2-1e65-47ec-8343-7fe712e76caa" released by "delete_volume" :: held 0.884s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Created reservations ['f451f817-ea83-46c6-8a02-f1ecb0a982e3', '53d46b6f-444c-44ba-b916-1acb40d56832', '87dca766-a96c-45a3-8c4d-161a8aef2bc8', '735ebeed-f2f4-4d43-b71b-2293b9ca7bc4'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Created reservations ['dd201f0b-c5ef-40ee-87ff-b5b0eac596f6', '37ec1233-c870-4c3f-9672-c5340c67cc06', '1d3284f5-8b4f-4dea-976a-371276b42b8d', 'cf38d801-fbf4-41d9-8fda-7c1cf5b3ab05'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:14 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:14 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:14 devstack sudo[104165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:14 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:14 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.324s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Deleted volume successfully.
Nov 07 02:46:14 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efc83998-bb7a-4522-acf7-406fb22638e9 tempest-TestStampPattern-174183251 None] Lock "cinder-4598a512-9ab3-411f-b7b1-72168028e618-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.297s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Deleted volume successfully.
Nov 07 02:46:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ef708366-fcc4-49c9-ac4b-de1f5780eb96 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-17e8b8a2-1e65-47ec-8343-7fe712e76caa-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Acquiring lock "cinder-4e87239f-6dc9-4f42-bba7-c9717f9092ef-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-4e87239f-6dc9-4f42-bba7-c9717f9092ef-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Acquiring lock "cinder-quobyte-4e87239f-6dc9-4f42-bba7-c9717f9092ef" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-4e87239f-6dc9-4f42-bba7-c9717f9092ef" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87a4431-5943-4983-9465-e987d8280cd7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:15 devstack sudo[104169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef
Nov 07 02:46:15 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:15 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef" returned: 0 in 0.430s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:15 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef
Nov 07 02:46:15 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:16 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e87239f-6dc9-4f42-bba7-c9717f9092ef" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-quobyte-4e87239f-6dc9-4f42-bba7-c9717f9092ef" released by "delete_volume" :: held 0.771s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Created reservations ['fe8fabe1-bca9-46ca-b8af-e074a707a0b6', '6e853b67-90db-49db-9813-13bb7da31340', 'a51e4911-70f6-425f-b1d2-57fd02a6426b', '1cbf6869-5337-4125-a8b9-c688474c93f4'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:16 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:16 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "cinder-238617f1-216d-47ef-a0bd-e4298ad83b76-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-238617f1-216d-47ef-a0bd-e4298ad83b76-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:16 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.336s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Deleted volume successfully.
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "cinder-quobyte-238617f1-216d-47ef-a0bd-e4298ad83b76" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-210fe8f4-e5d6-4863-b313-ff20d1895df7 tempest-VolumeDependencyTests-835911350 None] Lock "cinder-4e87239f-6dc9-4f42-bba7-c9717f9092ef-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-quobyte-238617f1-216d-47ef-a0bd-e4298ad83b76" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc3f804-ae35-4bba-a416-f9d3e5a18a71]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:16 devstack sudo[104180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76
Nov 07 02:46:16 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:17 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:17 devstack sudo[104185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76
Nov 07 02:46:17 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:17 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-238617f1-216d-47ef-a0bd-e4298ad83b76" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-quobyte-238617f1-216d-47ef-a0bd-e4298ad83b76" released by "delete_volume" :: held 0.745s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:17 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Created reservations ['3aafb568-5f9e-4855-8b17-80ee802b8002', 'f3e58106-1a3f-4e1f-9f41-ca1b27b435bf', '5a025b98-4d88-42ce-bb25-0a26e38dc995', '6e8a4ff0-748c-43ea-afee-8d0e8dc87ae6'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:17 devstack sudo[104189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:17 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:18 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.313s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "cinder-287508b8-547b-40e1-89ad-f38330636cc3-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Deleted volume successfully.
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-287508b8-547b-40e1-89ad-f38330636cc3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-372d1d07-43bd-4011-b2e6-e61e3dd2076c tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-238617f1-216d-47ef-a0bd-e4298ad83b76-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "cinder-quobyte-287508b8-547b-40e1-89ad-f38330636cc3" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-quobyte-287508b8-547b-40e1-89ad-f38330636cc3" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0171f5-0980-4eb7-bfed-722f0f07a7b6]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:18 devstack sudo[104193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3
Nov 07 02:46:18 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:18 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3" returned: 0 in 0.457s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:18 devstack sudo[104198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3
Nov 07 02:46:18 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:18 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-287508b8-547b-40e1-89ad-f38330636cc3" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-quobyte-287508b8-547b-40e1-89ad-f38330636cc3" released by "delete_volume" :: held 0.797s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Created reservations ['571e0bad-8722-495d-874f-fa85d246d065', '7deb877e-1d61-4d5d-844e-753f0bc78d56', '5f571a26-af4b-4a78-95ec-4af3a9ee0daa', '427891ad-5d62-47bd-bf69-b561221411f0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:19 devstack sudo[104201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:19 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:19 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.272s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Deleted volume successfully.
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3c18c053-906e-4081-abca-2e66e9829c86 tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-287508b8-547b-40e1-89ad-f38330636cc3-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "cinder-d058ccb8-bb34-46ec-8473-55f4e5ecff44-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-d058ccb8-bb34-46ec-8473-55f4e5ecff44-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "cinder-quobyte-d058ccb8-bb34-46ec-8473-55f4e5ecff44" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-quobyte-d058ccb8-bb34-46ec-8473-55f4e5ecff44" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f78a847-6e3c-4ed1-983c-631ce051defa]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:19 devstack sudo[104204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44
Nov 07 02:46:19 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:20 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44" returned: 0 in 0.511s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:20 devstack sudo[104209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44
Nov 07 02:46:20 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:20 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d058ccb8-bb34-46ec-8473-55f4e5ecff44" returned: 0 in 0.288s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-quobyte-d058ccb8-bb34-46ec-8473-55f4e5ecff44" released by "delete_volume" :: held 0.879s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:20 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Created reservations ['4067a2c5-b95b-4d4d-8223-3c910567171d', 'd6ba5962-7aa0-4072-8c5b-7e422ff5279c', '122092ce-9be9-430d-9907-ae55fd6b6ab3', '3d4de38a-bf65-4df8-ad81-a842b11bb823'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:20 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:20 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:21 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.413s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Deleted volume successfully.
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-65f51c62-3015-45e9-a3f2-4e9055408a5b tempest-AttachVolumeNegativeTest-1898104544 None] Lock "cinder-d058ccb8-bb34-46ec-8473-55f4e5ecff44-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Flow 'volume_create_manager' (517b8710-1963-4944-a794-e593022f6d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4685fe9d-851f-40fe-9226-0b054c7a496c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4685fe9d-851f-40fe-9226-0b054c7a496c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496986112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f288e2b7-1e16-4464-bb7b-d869bcd2422e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e526e1053b4282ab5b2d5fc0754113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:21Z,use_quota=True,user_id='1304c76c0ef84564a114ec5e3f6b471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d9e37d-9c96-48c8-a785-00c5bb1fc36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d9e37d-9c96-48c8-a785-00c5bb1fc36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e21f698-07db-491c-b4d4-ac1133f0b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e21f698-07db-491c-b4d4-ac1133f0b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f288e2b7-1e16-4464-bb7b-d869bcd2422e', 'volume_name': 'volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9eff1f0-1be2-426c-961f-749f46a352cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9eff1f0-1be2-426c-961f-749f46a352cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c199265-2754-4724-8749-b332196af20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Volume f288e2b7-1e16-4464-bb7b-d869bcd2422e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e', 'volume_size': 1}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496986112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f288e2b7-1e16-4464-bb7b-d869bcd2422e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e526e1053b4282ab5b2d5fc0754113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:21Z,use_quota=True,user_id='1304c76c0ef84564a114ec5e3f6b471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Creating volume f288e2b7-1e16-4464-bb7b-d869bcd2422e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:46:21 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:21 devstack sudo[104216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e 1073741824
Nov 07 02:46:21 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:21 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e 1073741824" returned: 0 in 0.531s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:21 devstack sudo[104222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e
Nov 07 02:46:21 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:22 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e" returned: 0 in 0.297s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:46:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c199265-2754-4724-8749-b332196af20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2ff283-79fe-43a2-8e0d-b9e5e81ec59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Volume volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e (f288e2b7-1e16-4464-bb7b-d869bcd2422e): created successfully
Nov 07 02:46:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2ff283-79fe-43a2-8e0d-b9e5e81ec59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Flow 'volume_create_manager' (517b8710-1963-4944-a794-e593022f6d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d53b00c7-8702-4c9b-a841-6892150f85f6 tempest-ProjectReaderTests-520059991 None] Created volume successfully.
Nov 07 02:46:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Acquiring lock "cinder-f288e2b7-1e16-4464-bb7b-d869bcd2422e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Lock "cinder-f288e2b7-1e16-4464-bb7b-d869bcd2422e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Acquiring lock "cinder-quobyte-f288e2b7-1e16-4464-bb7b-d869bcd2422e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Lock "cinder-quobyte-f288e2b7-1e16-4464-bb7b-d869bcd2422e" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c20ce1-250d-415f-bbb4-174088eab46d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:23 devstack sudo[104227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e
Nov 07 02:46:23 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:23 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e" returned: 0 in 0.359s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:23 devstack sudo[104232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e
Nov 07 02:46:23 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:24 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f288e2b7-1e16-4464-bb7b-d869bcd2422e" returned: 0 in 0.247s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Lock "cinder-quobyte-f288e2b7-1e16-4464-bb7b-d869bcd2422e" released by "delete_volume" :: held 0.677s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Created reservations ['ee10ee20-5c43-4d7f-984c-12808bc45b7b', 'be61d48b-5953-4b74-ad79-a6e294e20c0e', '8ef1d7c6-605e-4cee-b60f-c160aea96050', '322ef2f5-c634-4632-be87-7278b4f66d37'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:24 devstack sudo[104235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:24 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:24 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.418s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Deleted volume successfully.
Nov 07 02:46:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d6c7c35-d756-49d7-b641-4c11b24ad9d9 tempest-ProjectReaderTests-520059991 None] Lock "cinder-f288e2b7-1e16-4464-bb7b-d869bcd2422e-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Flow 'volume_create_manager' (ed733fce-bbb6-4e47-b5b9-f63e106763c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1b8775-9058-49d4-85e6-b73f3574c55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1b8775-9058-49d4-85e6-b73f3574c55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330852718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb1c54a-54a6-4223-ba57-03a17482698e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e526e1053b4282ab5b2d5fc0754113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:25Z,use_quota=True,user_id='1304c76c0ef84564a114ec5e3f6b471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5511db-9bc4-4006-8403-f07157a1fbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5511db-9bc4-4006-8403-f07157a1fbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a987b86-6a33-4271-a77a-efd5e4806a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a987b86-6a33-4271-a77a-efd5e4806a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cb1c54a-54a6-4223-ba57-03a17482698e', 'volume_name': 'volume-3cb1c54a-54a6-4223-ba57-03a17482698e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4230b3b-e02b-4613-803f-28106694f795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4230b3b-e02b-4613-803f-28106694f795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51d0895-ad3c-45cd-be7f-0cd8b388fc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Volume 3cb1c54a-54a6-4223-ba57-03a17482698e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cb1c54a-54a6-4223-ba57-03a17482698e', 'volume_size': 1}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330852718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb1c54a-54a6-4223-ba57-03a17482698e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e526e1053b4282ab5b2d5fc0754113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:25Z,use_quota=True,user_id='1304c76c0ef84564a114ec5e3f6b471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Creating volume 3cb1c54a-54a6-4223-ba57-03a17482698e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:46:25 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:25 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e 1073741824
Nov 07 02:46:25 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:25 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e 1073741824" returned: 0 in 0.569s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:26 devstack sudo[104247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e
Nov 07 02:46:26 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:26 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e" returned: 0 in 0.311s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:46:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51d0895-ad3c-45cd-be7f-0cd8b388fc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb1c54a-54a6-4223-ba57-03a17482698e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77342604-33be-45eb-9b0c-776110c5e8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Volume volume-3cb1c54a-54a6-4223-ba57-03a17482698e (3cb1c54a-54a6-4223-ba57-03a17482698e): created successfully
Nov 07 02:46:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77342604-33be-45eb-9b0c-776110c5e8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Flow 'volume_create_manager' (ed733fce-bbb6-4e47-b5b9-f63e106763c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-24dba799-538d-4ef9-80d6-28ed683788cf tempest-ProjectReaderTests-520059991 None] Created volume successfully.
Nov 07 02:46:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Acquiring lock "cinder-3cb1c54a-54a6-4223-ba57-03a17482698e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Lock "cinder-3cb1c54a-54a6-4223-ba57-03a17482698e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Acquiring lock "cinder-quobyte-3cb1c54a-54a6-4223-ba57-03a17482698e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Lock "cinder-quobyte-3cb1c54a-54a6-4223-ba57-03a17482698e" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f0d569-5cce-4083-826f-d03ace2220a5]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:27 devstack sudo[104250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e
Nov 07 02:46:27 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:28 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e" returned: 0 in 0.426s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:28 devstack sudo[104256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e
Nov 07 02:46:28 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:28 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3cb1c54a-54a6-4223-ba57-03a17482698e" returned: 0 in 0.267s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Lock "cinder-quobyte-3cb1c54a-54a6-4223-ba57-03a17482698e" released by "delete_volume" :: held 0.756s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Created reservations ['81aaae86-e15d-4527-80fc-0ebe12140999', 'a10a8945-d1a2-412b-bdd0-b0c73c7e8ef9', '8b73c801-409b-441b-8c13-4a6acf9dc310', 'c40e1f45-e757-43a4-9cce-1b59524fd239'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:28 devstack sudo[104261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:28 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:28 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.303s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Deleted volume successfully.
Nov 07 02:46:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51478a68-aff3-479b-9b89-46d9aa20132c tempest-ProjectReaderTests-520059991 None] Lock "cinder-3cb1c54a-54a6-4223-ba57-03a17482698e-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Flow 'volume_create_manager' (5c42594d-d79f-4f45-82d7-0a41b39d7e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b80fd9-6701-41d2-b374-2e54d881bc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b80fd9-6701-41d2-b374-2e54d881bc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786072543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5e7ee9-91a1-46da-b20e-ea333d6df98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e526e1053b4282ab5b2d5fc0754113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:29Z,use_quota=True,user_id='1304c76c0ef84564a114ec5e3f6b471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320c4e52-d9ee-41a0-87b5-a59fb9339e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320c4e52-d9ee-41a0-87b5-a59fb9339e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef42d94d-6650-411e-a635-a909c1fbf63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef42d94d-6650-411e-a635-a909c1fbf63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f5e7ee9-91a1-46da-b20e-ea333d6df98c', 'volume_name': 'volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637eca97-c2fc-4c6d-9aa8-2c8ea0e7b61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637eca97-c2fc-4c6d-9aa8-2c8ea0e7b61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59de3639-6487-4340-bd49-d48796b928fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Volume 3f5e7ee9-91a1-46da-b20e-ea333d6df98c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c', 'volume_size': 1}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786072543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5e7ee9-91a1-46da-b20e-ea333d6df98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e526e1053b4282ab5b2d5fc0754113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:29Z,use_quota=True,user_id='1304c76c0ef84564a114ec5e3f6b471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Creating volume 3f5e7ee9-91a1-46da-b20e-ea333d6df98c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:46:29 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:29 devstack sudo[104264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c 1073741824
Nov 07 02:46:29 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:29 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c 1073741824" returned: 0 in 0.543s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:29 devstack sudo[104270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c
Nov 07 02:46:29 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:30 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:46:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59de3639-6487-4340-bd49-d48796b928fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0500b118-ce06-459b-b8b6-67cb65b01df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Volume volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c (3f5e7ee9-91a1-46da-b20e-ea333d6df98c): created successfully
Nov 07 02:46:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0500b118-ce06-459b-b8b6-67cb65b01df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Flow 'volume_create_manager' (5c42594d-d79f-4f45-82d7-0a41b39d7e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7a415bf4-2078-497f-8330-0276fc660753 tempest-ProjectReaderTests-520059991 None] Created volume successfully.
Nov 07 02:46:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Acquiring lock "cinder-3f5e7ee9-91a1-46da-b20e-ea333d6df98c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Lock "cinder-3f5e7ee9-91a1-46da-b20e-ea333d6df98c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Acquiring lock "cinder-quobyte-3f5e7ee9-91a1-46da-b20e-ea333d6df98c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Lock "cinder-quobyte-3f5e7ee9-91a1-46da-b20e-ea333d6df98c" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[06393b71-0b69-4fc1-9251-a101dd20277c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:31 devstack sudo[104273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c
Nov 07 02:46:31 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:31 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c" returned: 0 in 0.459s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:32 devstack sudo[104279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c
Nov 07 02:46:32 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:32 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f5e7ee9-91a1-46da-b20e-ea333d6df98c" returned: 0 in 0.313s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Lock "cinder-quobyte-3f5e7ee9-91a1-46da-b20e-ea333d6df98c" released by "delete_volume" :: held 0.834s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Created reservations ['3b14ca87-2e00-43c8-93d9-837a7f55dda5', '7e214f2f-0fa7-46c0-b66f-6632fbea87d1', '30d19d6d-7fd6-47c5-a5d4-9f871ff26d18', '66192d4c-e6f6-4060-a8ad-629595980327'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:32 devstack sudo[104282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:32 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:32 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.374s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Deleted volume successfully.
Nov 07 02:46:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1d7ef3dc-c45a-47fe-944a-968f757e0a52 tempest-ProjectReaderTests-520059991 None] Lock "cinder-3f5e7ee9-91a1-46da-b20e-ea333d6df98c-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Flow 'volume_create_manager' (86979f80-7e28-4c79-9ad7-d5c177133344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72edf372-6e5e-40ad-8d95-516337c88ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72edf372-6e5e-40ad-8d95-516337c88ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793213333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e526e1053b4282ab5b2d5fc0754113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:33Z,use_quota=True,user_id='1304c76c0ef84564a114ec5e3f6b471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a2ec73-9dfa-4252-bffb-40bcfc85f7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a2ec73-9dfa-4252-bffb-40bcfc85f7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f038f3-567d-48b8-b36c-9b405180198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f038f3-567d-48b8-b36c-9b405180198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118', 'volume_name': 'volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599e9397-9fd1-4895-b95c-3f9baec31442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599e9397-9fd1-4895-b95c-3f9baec31442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e88fcf-4747-4568-9e79-d994d10f5f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:33 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Volume b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118', 'volume_size': 1}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793213333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e526e1053b4282ab5b2d5fc0754113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:33Z,use_quota=True,user_id='1304c76c0ef84564a114ec5e3f6b471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Creating volume b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:46:33 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:33 devstack sudo[104285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118 1073741824
Nov 07 02:46:33 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Flow 'volume_create_manager' (e265335c-bc69-4e87-af52-fd5d877ff3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfef779d-12ee-46c0-80e3-ea09a7981b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfef779d-12ee-46c0-80e3-ea09a7981b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c339751-4633-4e68-b719-57781fda6b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041461bbe3034708a783bcdd8b611c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:34Z,use_quota=True,user_id='9ec3e91d509a430b88f1b51aab81584e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00161db9-0f9a-4227-a64c-400dcca569a7),volume_type_id=00161db9-0f9a-4227-a64c-400dcca569a7)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed79a22-941f-40db-aaa0-1afd6f8845aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed79a22-941f-40db-aaa0-1afd6f8845aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf59387a-b032-4945-9be7-e4a3f9250234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:46:33 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118 1073741824" returned: 0 in 0.528s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:33 devstack sudo[104291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118
Nov 07 02:46:33 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:34 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118" returned: 0 in 0.271s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e88fcf-4747-4568-9e79-d994d10f5f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f141e3f3-e25a-414a-9e3c-612004b46451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Volume volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118 (b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118): created successfully
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f141e3f3-e25a-414a-9e3c-612004b46451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Flow 'volume_create_manager' (86979f80-7e28-4c79-9ad7-d5c177133344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf59387a-b032-4945-9be7-e4a3f9250234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c339751-4633-4e68-b719-57781fda6b68', 'volume_name': 'volume-4c339751-4633-4e68-b719-57781fda6b68', 'volume_size': 1, 'image_id': '4e72f904-7749-4315-829f-79e0b26b68e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e72f904-7749-4315-829f-79e0b26b68e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf9b4243727a7c095121a21ef3e373a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '041461bbe3034708a783bcdd8b611c6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35de93b07e70754a86fe42aa1b97e782eb97709a599722ef28929973d9aea0cfb389e7c29a7b7fe186a4663ef08ba4add9c77564cc3361ebf49283788a2972a5', 'id': '4e72f904-7749-4315-829f-79e0b26b68e3', 'created_at': datetime.datetime(2026, 11, 7, 1, 46, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e72f904-7749-4315-829f-79e0b26b68e3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb553920>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc68f27-77ee-440a-84c6-62ce0c67c28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc68f27-77ee-440a-84c6-62ce0c67c28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7458fe3-28ec-4465-8f6c-0dce81527c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Volume 4c339751-4633-4e68-b719-57781fda6b68: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c339751-4633-4e68-b719-57781fda6b68', 'volume_size': 1, 'image_id': '4e72f904-7749-4315-829f-79e0b26b68e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e72f904-7749-4315-829f-79e0b26b68e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf9b4243727a7c095121a21ef3e373a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '041461bbe3034708a783bcdd8b611c6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35de93b07e70754a86fe42aa1b97e782eb97709a599722ef28929973d9aea0cfb389e7c29a7b7fe186a4663ef08ba4add9c77564cc3361ebf49283788a2972a5', 'id': '4e72f904-7749-4315-829f-79e0b26b68e3', 'created_at': datetime.datetime(2026, 11, 7, 1, 46, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e72f904-7749-4315-829f-79e0b26b68e3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb553920>}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Trying to clone 4c339751-4633-4e68-b719-57781fda6b68 from image 4e72f904-7749-4315-829f-79e0b26b68e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e72f904-7749-4315-829f-79e0b26b68e3', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:46:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-15acf664-dce7-4f85-87d0-3493954334c0 tempest-ProjectReaderTests-520059991 None] Created volume successfully.
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:46:34 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Image download 0.00 MB at 0.00 MB/s
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4003c547-2e62-4d61-9892-fec807d4fe82]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:34 devstack sudo[104294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD
Nov 07 02:46:34 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:34 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:34 devstack sudo[104298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD
Nov 07 02:46:34 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:35 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Temporary image 4e72f904-7749-4315-829f-79e0b26b68e3 is fetched for user 9ec3e91d509a430b88f1b51aab81584e. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[892949ac-9164-486e-bb2e-b3b67d44b93c]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:35 devstack sudo[104303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD
Nov 07 02:46:35 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Acquiring lock "cinder-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Lock "cinder-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Acquiring lock "cinder-quobyte-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Lock "cinder-quobyte-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d924dfe-0f25-46bc-8077-a5ad15d2d907]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:35 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:35 devstack sudo[104307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118
Nov 07 02:46:35 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:35 devstack sudo[104308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD
Nov 07 02:46:35 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:35 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118" returned: 0 in 0.390s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:35 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c339751-4633-4e68-b719-57781fda6b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041461bbe3034708a783bcdd8b611c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:34Z,use_quota=True,user_id='9ec3e91d509a430b88f1b51aab81584e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00161db9-0f9a-4227-a64c-400dcca569a7),volume_type_id=00161db9-0f9a-4227-a64c-400dcca569a7)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Creating volume 4c339751-4633-4e68-b719-57781fda6b68 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:46:35 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:46:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:35 devstack sudo[104318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118
Nov 07 02:46:35 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:35 devstack sudo[104320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68 1073741824
Nov 07 02:46:35 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:36 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118" returned: 0 in 0.293s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Lock "cinder-quobyte-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118" released by "delete_volume" :: held 0.733s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Created reservations ['394d77e2-06af-402e-a3ec-59a19dd3f5ad', 'f2c3a526-48c7-4fa7-b4ce-6d361ff162e0', '41ec764e-b4e4-41f8-ab7c-3c8f97dae17c', '40cee66f-bd9a-401a-ab39-5ec97629b165'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:36 devstack sudo[104327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:36 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:36 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68 1073741824" returned: 0 in 0.509s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:36 devstack sudo[104329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68
Nov 07 02:46:36 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:36 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Deleted volume successfully.
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb555e-00fc-479e-9ab1-84fa2a6adc72 tempest-ProjectReaderTests-520059991 None] Lock "cinder-b9ed133d-4c9c-4dd8-b6a7-81d35aa7d118-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ec471aeb-3442-4b9d-b64a-2ce9ff6837ec tempest-GroupsV314Test-2089572380 None] Group tempest-GroupsV314Test-Group-753836996: creating
Nov 07 02:46:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ec471aeb-3442-4b9d-b64a-2ce9ff6837ec tempest-GroupsV314Test-2089572380 None] Group tempest-GroupsV314Test-Group-753836996: created successfully
Nov 07 02:46:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ec471aeb-3442-4b9d-b64a-2ce9ff6837ec tempest-GroupsV314Test-2089572380 None] Create group completed successfully.
Nov 07 02:46:36 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68" returned: 0 in 0.340s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Attempting download of 4e72f904-7749-4315-829f-79e0b26b68e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e72f904-7749-4315-829f-79e0b26b68e3', 'metadata': {}}])) to volume 4c339751-4633-4e68-b719-57781fda6b68. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86341c8-7390-4997-b3a8-d942c7248cb0]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e72f904-7749-4315-829f-79e0b26b68e3__zo6_z1w {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:37 devstack sudo[104333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e72f904-7749-4315-829f-79e0b26b68e3__zo6_z1w
Nov 07 02:46:37 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:37 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e72f904-7749-4315-829f-79e0b26b68e3__zo6_z1w" returned: 0 in 0.331s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e72f904-7749-4315-829f-79e0b26b68e3__zo6_z1w {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:37 devstack sudo[104337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e72f904-7749-4315-829f-79e0b26b68e3__zo6_z1w
Nov 07 02:46:37 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:37 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e72f904-7749-4315-829f-79e0b26b68e3__zo6_z1w" returned: 1 in 0.330s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e72f904-7749-4315-829f-79e0b26b68e3__zo6_z1w' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:46:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e893ade6-80e2-426f-8271-53971e86c5a8]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:37 devstack sudo[104341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD
Nov 07 02:46:37 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:37 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:38 devstack sudo[104345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD
Nov 07 02:46:38 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:38 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD" returned: 1 in 0.467s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] 4e72f904-7749-4315-829f-79e0b26b68e3 was raw, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:38 devstack sudo[104387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68
Nov 07 02:46:38 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Flow 'volume_create_manager' (159963e6-ffc4-43cb-b499-4ab3df0503c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe612dc8-7c39-4b34-8f5f-eb37b9d8e013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe612dc8-7c39-4b34-8f5f-eb37b9d8e013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-220426118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07a53cf8-ef97-4f7e-a56a-f16839966b95,host='devstack@QuobyteHD#QuobyteHD',id=c2fffbbc-4098-4b18-9003-6a7a860cdad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c74df14a964b7daf04f686c50e8585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:39Z,use_quota=True,user_id='76407d9d158948fb95447525b9098ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d9ba887-0840-47dd-9d56-5eaef20dac11),volume_type_id=4d9ba887-0840-47dd-9d56-5eaef20dac11)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60bcb214-e17c-4c92-b204-18133293d7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60bcb214-e17c-4c92-b204-18133293d7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a170781-fbc3-4e0e-8a22-07b222f2da0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a170781-fbc3-4e0e-8a22-07b222f2da0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fffbbc-4098-4b18-9003-6a7a860cdad8', 'volume_name': 'volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cd7e3e-2c0b-4a51-ae90-50d0a40527b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cd7e3e-2c0b-4a51-ae90-50d0a40527b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9c0cf4-96f3-4a95-aa53-00fcbf8ad26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Volume c2fffbbc-4098-4b18-9003-6a7a860cdad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8', 'volume_size': 1}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=07a53cf8-ef97-4f7e-a56a-f16839966b95,created_at=2026-11-07T01:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-220426118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07a53cf8-ef97-4f7e-a56a-f16839966b95,host='devstack@QuobyteHD#QuobyteHD',id=c2fffbbc-4098-4b18-9003-6a7a860cdad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c74df14a964b7daf04f686c50e8585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:39Z,use_quota=True,user_id='76407d9d158948fb95447525b9098ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d9ba887-0840-47dd-9d56-5eaef20dac11),volume_type_id=4d9ba887-0840-47dd-9d56-5eaef20dac11)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Creating volume c2fffbbc-4098-4b18-9003-6a7a860cdad8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:46:38 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:38 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 1073741824
Nov 07 02:46:38 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:38 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68" returned: 0 in 0.567s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e72f904-7749-4315-829f-79e0b26b68e3_d0iqdvo1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:46:38 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Converted 0.00 MB image at 0.00 MB/s
Nov 07 02:46:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:39 devstack sudo[104397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68 1G
Nov 07 02:46:39 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:39 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 1073741824" returned: 0 in 0.494s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:39 devstack sudo[104401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8
Nov 07 02:46:39 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:39 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68 1G" returned: 0 in 0.374s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Downloaded image 4e72f904-7749-4315-829f-79e0b26b68e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e72f904-7749-4315-829f-79e0b26b68e3', 'metadata': {}}])) to volume 4c339751-4633-4e68-b719-57781fda6b68 successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Temporary image 4e72f904-7749-4315-829f-79e0b26b68e3 for user 9ec3e91d509a430b88f1b51aab81584e is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Marking volume 4c339751-4633-4e68-b719-57781fda6b68 as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Copying metadata from image 4e72f904-7749-4315-829f-79e0b26b68e3 to 4c339751-4633-4e68-b719-57781fda6b68. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Creating volume glance metadata for volume 4c339751-4633-4e68-b719-57781fda6b68 backed by image 4e72f904-7749-4315-829f-79e0b26b68e3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4e72f904-7749-4315-829f-79e0b26b68e3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cf9b4243727a7c095121a21ef3e373a5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7458fe3-28ec-4465-8f6c-0dce81527c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c339751-4633-4e68-b719-57781fda6b68', 'volume_size': 1, 'image_id': '4e72f904-7749-4315-829f-79e0b26b68e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e72f904-7749-4315-829f-79e0b26b68e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf9b4243727a7c095121a21ef3e373a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '041461bbe3034708a783bcdd8b611c6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35de93b07e70754a86fe42aa1b97e782eb97709a599722ef28929973d9aea0cfb389e7c29a7b7fe186a4663ef08ba4add9c77564cc3361ebf49283788a2972a5', 'id': '4e72f904-7749-4315-829f-79e0b26b68e3', 'created_at': datetime.datetime(2026, 11, 7, 1, 46, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e72f904-7749-4315-829f-79e0b26b68e3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb553920>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330eb504-6f20-4d7b-b662-245ba708c749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Volume volume-4c339751-4633-4e68-b719-57781fda6b68 (4c339751-4633-4e68-b719-57781fda6b68): created successfully
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330eb504-6f20-4d7b-b662-245ba708c749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Flow 'volume_create_manager' (e265335c-bc69-4e87-af52-fd5d877ff3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:39 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8" returned: 0 in 0.279s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d8fa86dd-9d71-48ed-83ac-4635df5083af tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Created volume successfully.
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9c0cf4-96f3-4a95-aa53-00fcbf8ad26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfaf7c9e-e81d-40dc-af38-217550d97e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Volume volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 (c2fffbbc-4098-4b18-9003-6a7a860cdad8): created successfully
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfaf7c9e-e81d-40dc-af38-217550d97e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Flow 'volume_create_manager' (159963e6-ffc4-43cb-b499-4ab3df0503c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-05c725a7-9d0c-4f8f-87fc-54d3b515ec9f tempest-GroupsV314Test-2089572380 None] Created volume successfully.
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Acquiring lock "cinder-4c339751-4633-4e68-b719-57781fda6b68-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Lock "cinder-4c339751-4633-4e68-b719-57781fda6b68-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Acquiring lock "cinder-quobyte-4c339751-4633-4e68-b719-57781fda6b68" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Lock "cinder-quobyte-4c339751-4633-4e68-b719-57781fda6b68" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea24eb-f62d-4528-9d04-9f4e538ba9df]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:40 devstack sudo[104407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68
Nov 07 02:46:40 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:40 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Cloning volume c2fffbbc-4098-4b18-9003-6a7a860cdad8 to volume 346f1df6-6865-44c0-bec6-78a4d23f11e6
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Creating offline snapshot 6382b518-10c8-4df0-9baf-da58c011b6d7 of volume c2fffbbc-4098-4b18-9003-6a7a860cdad8 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a420ed-5c56-4360-a45c-cba8575da8f8]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:40 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:40 devstack sudo[104410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8
Nov 07 02:46:40 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:40 devstack sudo[104413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68
Nov 07 02:46:40 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:41 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c339751-4633-4e68-b719-57781fda6b68" returned: 0 in 0.446s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:41 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Lock "cinder-quobyte-4c339751-4633-4e68-b719-57781fda6b68" released by "delete_volume" :: held 1.002s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8" returned: 0 in 0.620s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:41 devstack sudo[104421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7 1G
Nov 07 02:46:41 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:41 devstack cinder-volume[87087]: WARNING cinder.quota [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:46:41 devstack cinder-volume[87087]: WARNING cinder.quota [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Created reservations ['9fcf06a0-859c-478f-918a-16272a3afde9', 'e218798a-2e25-4738-bb19-dfbfd0bc4512', '99f36dd5-621d-4cf4-9aac-efad7daa4272', '9638b861-a9c5-4134-ba4e-6bca8810fba9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:41 devstack sudo[104423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:41 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:41 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7 1G" returned: 0 in 0.471s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:41 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.291s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Deleted volume successfully.
Nov 07 02:46:41 devstack sudo[104429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7
Nov 07 02:46:41 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b95e4955-87cd-4974-8f70-ea54d4a2511f tempest-VolumeAndVolumeTypeFromImageTest-1983525232 None] Lock "cinder-4c339751-4633-4e68-b719-57781fda6b68-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:41 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7" returned: 0 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:41 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7 is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:46:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:41 devstack sudo[104434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7
Nov 07 02:46:41 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:42 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7" returned: 0 in 0.286s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:42 devstack sudo[104437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.info
Nov 07 02:46:42 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:42 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.info" returned: 0 in 0.334s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:42 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:46:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:42 devstack sudo[104441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.info
Nov 07 02:46:42 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:42 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.info" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Acquiring lock "cinder-quobyte-346f1df6-6865-44c0-bec6-78a4d23f11e6" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Lock "cinder-quobyte-346f1df6-6865-44c0-bec6-78a4d23f11e6" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] snapshot: 6382b518-10c8-4df0-9baf-da58c011b6d7, volume: 346f1df6-6865-44c0-bec6-78a4d23f11e6,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:46:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63033e2-2bbc-4b75-b78a-657f687767e2]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:43 devstack sudo[104445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7
Nov 07 02:46:43 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:43 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7" returned: 0 in 0.447s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:46:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e21809f-5e55-4fea-9d36-ec5725f888eb]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:43 devstack sudo[104450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8
Nov 07 02:46:43 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:43 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8" returned: 0 in 0.488s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:46:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:46:44 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:46:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:44 devstack sudo[104455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6
Nov 07 02:46:44 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:52 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=127,cinder:INSERT=38,cinder:UPDATE=139,cinder:DELETE=8 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:46:52 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=145,cinder:SELECT=118,cinder:DELETE=14,cinder:INSERT=40 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:46:52 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6" returned: 0 in 8.990s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8, size 1024.00 MB, duration 8.99 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:46:53 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Converted 1024.00 MB image at 113.89 MB/s
Nov 07 02:46:53 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6 is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:53 devstack sudo[104475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6
Nov 07 02:46:53 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:53 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6" returned: 0 in 0.274s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Lock "cinder-quobyte-346f1df6-6865-44c0-bec6-78a4d23f11e6" released by "_copy_volume_from_snapshot" :: held 10.308s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Acquiring lock "cinder-quobyte-6382b518-10c8-4df0-9baf-da58c011b6d7" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Lock "cinder-quobyte-6382b518-10c8-4df0-9baf-da58c011b6d7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Deleting offline snapshot 6382b518-10c8-4df0-9baf-da58c011b6d7 of volume c2fffbbc-4098-4b18-9003-6a7a860cdad8 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] snapshot_file for this snap is: volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e03c82-5974-41c3-966e-13c7e1bcbfb5]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:53 devstack sudo[104478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:53 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:53 devstack sudo[104479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7
Nov 07 02:46:53 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:53 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.440s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:46:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:46:54 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7" returned: 0 in 0.682s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:46:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dc4f4b-7da7-49df-85b4-0f95070b6052]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:54 devstack sudo[104486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8
Nov 07 02:46:54 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:54 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8" returned: 0 in 0.602s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:54 devstack sudo[104492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7
Nov 07 02:46:54 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:55 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7" returned: 0 in 0.434s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:55 devstack sudo[104498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7
Nov 07 02:46:55 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:55 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8.6382b518-10c8-4df0-9baf-da58c011b6d7" returned: 0 in 0.322s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Lock "cinder-quobyte-6382b518-10c8-4df0-9baf-da58c011b6d7" released by "_delete_snapshot" :: held 2.201s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.142s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-66c2b9f4-41c1-447c-a3c7-7c51edf1ab50 tempest-GroupsV314Test-2089572380 None] Create group from source-group-07a53cf8-ef97-4f7e-a56a-f16839966b95 completed successfully.
Nov 07 02:46:55 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Flow 'volume_create_manager' (22b2e58b-9c6a-4f75-8426-10981c82aba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32483170-acb2-4ca3-8e83-0dfead7df600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32483170-acb2-4ca3-8e83-0dfead7df600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24b8620-68c7-452f-af14-e25efca9e5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8294d46892c0465b9a87bc2e232636e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:56Z,use_quota=True,user_id='bf9a862b1dec46b69f5b6877c7eb5aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169e9d0b-77f2-4616-96fb-810c2934ebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169e9d0b-77f2-4616-96fb-810c2934ebbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58c3d19-16eb-4ea1-92e9-9dd708b839db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58c3d19-16eb-4ea1-92e9-9dd708b839db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c24b8620-68c7-452f-af14-e25efca9e5b2', 'volume_name': 'volume-c24b8620-68c7-452f-af14-e25efca9e5b2', 'volume_size': 1, 'image_id': '6e982e92-dc77-430b-b3aa-4d71cdac140d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e982e92-dc77-430b-b3aa-4d71cdac140d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38b8f4f8e9310ad56ef1d839666766ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8294d46892c0465b9a87bc2e232636e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '339f38339c7e0e623ab3bc7216056bb6b6a4c086eee816b5497e63c5cd3070f76dfa4222275a27e59b77ae788d90134454aece3ab05da8901f5f80e8288a02c5', 'id': '6e982e92-dc77-430b-b3aa-4d71cdac140d', 'created_at': datetime.datetime(2026, 11, 7, 1, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 46, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e982e92-dc77-430b-b3aa-4d71cdac140d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb4b62a0>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4f057b-0539-46e0-a357-f8ee4b375706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4f057b-0539-46e0-a357-f8ee4b375706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3050a89a-eef8-4a5e-a601-c156dab67883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Volume c24b8620-68c7-452f-af14-e25efca9e5b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c24b8620-68c7-452f-af14-e25efca9e5b2', 'volume_size': 1, 'image_id': '6e982e92-dc77-430b-b3aa-4d71cdac140d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e982e92-dc77-430b-b3aa-4d71cdac140d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38b8f4f8e9310ad56ef1d839666766ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8294d46892c0465b9a87bc2e232636e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '339f38339c7e0e623ab3bc7216056bb6b6a4c086eee816b5497e63c5cd3070f76dfa4222275a27e59b77ae788d90134454aece3ab05da8901f5f80e8288a02c5', 'id': '6e982e92-dc77-430b-b3aa-4d71cdac140d', 'created_at': datetime.datetime(2026, 11, 7, 1, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 46, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e982e92-dc77-430b-b3aa-4d71cdac140d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb4b62a0>}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Trying to clone c24b8620-68c7-452f-af14-e25efca9e5b2 from image 6e982e92-dc77-430b-b3aa-4d71cdac140d at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e982e92-dc77-430b-b3aa-4d71cdac140d', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:46:56 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Image download 0.00 MB at 0.00 MB/s
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[86214996-2459-472e-83fd-41436882f31f]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:56 devstack sudo[104501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD
Nov 07 02:46:56 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:56 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Acquiring lock "cinder-quobyte-346f1df6-6865-44c0-bec6-78a4d23f11e6" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Lock "cinder-quobyte-346f1df6-6865-44c0-bec6-78a4d23f11e6" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:56 devstack sudo[104505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD
Nov 07 02:46:56 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5a56f0-5986-419a-b0b7-b5b0fb4cc36a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:57 devstack sudo[104507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6
Nov 07 02:46:57 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:57 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Temporary image 6e982e92-dc77-430b-b3aa-4d71cdac140d is fetched for user bf9a862b1dec46b69f5b6877c7eb5aff. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[675acc21-be16-4ec2-9984-d53616df28ee]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:57 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6" returned: 0 in 0.448s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:57 devstack sudo[104517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6
Nov 07 02:46:57 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:57 devstack sudo[104514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD
Nov 07 02:46:57 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:57 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:57 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-346f1df6-6865-44c0-bec6-78a4d23f11e6" returned: 0 in 0.281s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Lock "cinder-quobyte-346f1df6-6865-44c0-bec6-78a4d23f11e6" released by "delete_volume" :: held 0.804s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Created reservations ['6b94c0d2-cc53-426e-b843-e8d2e3f31f2c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:57 devstack sudo[104523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD
Nov 07 02:46:57 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:57 devstack cinder-volume[87087]: WARNING cinder.quota [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-240542793 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-240542793, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:46:57 devstack cinder-volume[87087]: WARNING cinder.quota [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-240542793 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-240542793, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:46:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Created reservations ['c20e161c-5cb2-419b-b810-f92ebbee476e', '2fd612f5-3fe1-4ce8-bf7d-197a71dca6d6', 'f51ed4e7-c448-41c7-a45e-4dec11d8e81a', 'bc52b208-76cc-4ca7-a8e1-0062c0737d39'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:58 devstack sudo[104526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:58 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:58 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24b8620-68c7-452f-af14-e25efca9e5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8294d46892c0465b9a87bc2e232636e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:56Z,use_quota=True,user_id='bf9a862b1dec46b69f5b6877c7eb5aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Creating volume c24b8620-68c7-452f-af14-e25efca9e5b2 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:46:58 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:58 devstack sudo[104531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2 1073741824
Nov 07 02:46:58 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:58 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.299s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1c3c7ab6-259c-41f4-92ba-e55a19f0ba99 tempest-GroupsV314Test-2089572380 None] Delete group completed successfully.
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Acquiring lock "cinder-quobyte-c2fffbbc-4098-4b18-9003-6a7a860cdad8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Lock "cinder-quobyte-c2fffbbc-4098-4b18-9003-6a7a860cdad8" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9577e3d6-9641-4a85-a63b-c50b7024d0a9]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:58 devstack sudo[104537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8
Nov 07 02:46:58 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:58 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2 1073741824" returned: 0 in 0.576s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:58 devstack sudo[104540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2
Nov 07 02:46:58 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:59 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8" returned: 0 in 0.514s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:59 devstack sudo[104546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8
Nov 07 02:46:59 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:59 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Attempting download of 6e982e92-dc77-430b-b3aa-4d71cdac140d ((None, [{'url': 'file:///opt/stack/data/glance/images/6e982e92-dc77-430b-b3aa-4d71cdac140d', 'metadata': {}}])) to volume c24b8620-68c7-452f-af14-e25efca9e5b2. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c8da62-9567-4c8f-b72f-1379c9308173]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e982e92-dc77-430b-b3aa-4d71cdac140d_8x9rcxel {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:59 devstack sudo[104548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e982e92-dc77-430b-b3aa-4d71cdac140d_8x9rcxel
Nov 07 02:46:59 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:59 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c2fffbbc-4098-4b18-9003-6a7a860cdad8" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Lock "cinder-quobyte-c2fffbbc-4098-4b18-9003-6a7a860cdad8" released by "delete_volume" :: held 0.875s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Created reservations ['eb3992db-1ab3-4f78-a074-b5acadb27444'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Created reservations ['61434c6e-ae51-4395-8950-46478589f8ee', '0843db83-6c13-4533-b8a1-3c206249e4c7', '356b67b2-80e6-40c3-a676-5aaf3abaf6b4', 'e14f06e5-ffc9-401b-9f3a-b70aedec6163'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:59 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e982e92-dc77-430b-b3aa-4d71cdac140d_8x9rcxel" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e982e92-dc77-430b-b3aa-4d71cdac140d_8x9rcxel {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:59 devstack sudo[104554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:46:59 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:59 devstack sudo[104553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e982e92-dc77-430b-b3aa-4d71cdac140d_8x9rcxel
Nov 07 02:46:59 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:00 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e982e92-dc77-430b-b3aa-4d71cdac140d_8x9rcxel" returned: 1 in 0.488s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e982e92-dc77-430b-b3aa-4d71cdac140d_8x9rcxel' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[779bcf52-134f-4b08-a7b7-801d7cf3cc78]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:00 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.474s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-daec7ed8-982b-43d0-96c3-263625de7ee4 tempest-GroupsV314Test-2089572380 None] Delete group completed successfully.
Nov 07 02:47:00 devstack sudo[104560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD
Nov 07 02:47:00 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:00 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:00 devstack sudo[104564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD
Nov 07 02:47:00 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:00 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] 6e982e92-dc77-430b-b3aa-4d71cdac140d was raw, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:47:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:00 devstack sudo[104569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2
Nov 07 02:47:00 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:01 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2" returned: 0 in 0.564s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e982e92-dc77-430b-b3aa-4d71cdac140d_saeojc9zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:47:01 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Converted 0.00 MB image at 0.00 MB/s
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:01 devstack sudo[104575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2 1G
Nov 07 02:47:01 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:01 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2 1G" returned: 0 in 0.407s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Downloaded image 6e982e92-dc77-430b-b3aa-4d71cdac140d ((None, [{'url': 'file:///opt/stack/data/glance/images/6e982e92-dc77-430b-b3aa-4d71cdac140d', 'metadata': {}}])) to volume c24b8620-68c7-452f-af14-e25efca9e5b2 successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Temporary image 6e982e92-dc77-430b-b3aa-4d71cdac140d for user bf9a862b1dec46b69f5b6877c7eb5aff is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Marking volume c24b8620-68c7-452f-af14-e25efca9e5b2 as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Copying metadata from image 6e982e92-dc77-430b-b3aa-4d71cdac140d to c24b8620-68c7-452f-af14-e25efca9e5b2. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Creating volume glance metadata for volume c24b8620-68c7-452f-af14-e25efca9e5b2 backed by image 6e982e92-dc77-430b-b3aa-4d71cdac140d with: {'image_id': '6e982e92-dc77-430b-b3aa-4d71cdac140d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '38b8f4f8e9310ad56ef1d839666766ab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3050a89a-eef8-4a5e-a601-c156dab67883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24b8620-68c7-452f-af14-e25efca9e5b2', 'volume_size': 1, 'image_id': '6e982e92-dc77-430b-b3aa-4d71cdac140d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e982e92-dc77-430b-b3aa-4d71cdac140d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38b8f4f8e9310ad56ef1d839666766ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8294d46892c0465b9a87bc2e232636e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '339f38339c7e0e623ab3bc7216056bb6b6a4c086eee816b5497e63c5cd3070f76dfa4222275a27e59b77ae788d90134454aece3ab05da8901f5f80e8288a02c5', 'id': '6e982e92-dc77-430b-b3aa-4d71cdac140d', 'created_at': datetime.datetime(2026, 11, 7, 1, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 46, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e982e92-dc77-430b-b3aa-4d71cdac140d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb4b62a0>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b8be34-f7c5-4985-93d6-5faf7f7bbdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:01 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Volume volume-c24b8620-68c7-452f-af14-e25efca9e5b2 (c24b8620-68c7-452f-af14-e25efca9e5b2): created successfully
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b8be34-f7c5-4985-93d6-5faf7f7bbdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Flow 'volume_create_manager' (22b2e58b-9c6a-4f75-8426-10981c82aba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b24a03fa-5722-4c68-8c70-acb548029114 tempest-VolumeImageDependencyTests-1069337167 None] Created volume successfully.
Nov 07 02:47:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Acquiring lock "cinder-c24b8620-68c7-452f-af14-e25efca9e5b2-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Lock "cinder-c24b8620-68c7-452f-af14-e25efca9e5b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Acquiring lock "cinder-quobyte-c24b8620-68c7-452f-af14-e25efca9e5b2" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Lock "cinder-quobyte-c24b8620-68c7-452f-af14-e25efca9e5b2" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3e10ee-b97c-4396-9018-6c4f389fd954]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:02 devstack sudo[104581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2
Nov 07 02:47:02 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:03 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2" returned: 0 in 0.465s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:03 devstack sudo[104586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2
Nov 07 02:47:03 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:03 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c24b8620-68c7-452f-af14-e25efca9e5b2" returned: 0 in 0.383s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Lock "cinder-quobyte-c24b8620-68c7-452f-af14-e25efca9e5b2" released by "delete_volume" :: held 0.926s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Created reservations ['7ba2dad0-eb60-4925-9c89-92bfd03566c2', '85d511c8-9d48-4a63-b2c7-2157203e7d2e', '0db97a3f-40d4-4c1f-bbf3-ea87aefcb88a', '24607dbb-99f4-4df5-8899-4140e79b56dd'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:03 devstack sudo[104589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:03 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:03 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.310s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:03 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Deleted volume successfully.
Nov 07 02:47:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7f0ed518-528a-45c4-beeb-a7074826ea61 tempest-VolumeImageDependencyTests-1069337167 None] Lock "cinder-c24b8620-68c7-452f-af14-e25efca9e5b2-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Flow 'volume_create_manager' (f7ebafb5-73d4-41df-90a6-6d5103154f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f463233-b972-46e7-b168-618db78c6c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-90ca3708-da7f-4aaa-a328-b1938ea2ca42 tempest-GroupsV320Test-716355651 None] Group tempest-GroupsV320Test-Group-1876367670: creating
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f463233-b972-46e7-b168-618db78c6c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1269467253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0eff3f-35ad-43a1-827c-67d6f88d63d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4832bcdf027f487d892cd7feac690214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:07Z,use_quota=True,user_id='7fc6b774c7f147b18a8ea604d6cc30bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bae548-6ef4-413a-b954-d1dfb1a960bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bae548-6ef4-413a-b954-d1dfb1a960bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ff2372-fe66-42e3-a8fc-7279c10b7925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ff2372-fe66-42e3-a8fc-7279c10b7925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c0eff3f-35ad-43a1-827c-67d6f88d63d4', 'volume_name': 'volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9aaa15-8f27-4c40-a86b-33590209aa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9aaa15-8f27-4c40-a86b-33590209aa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367a010f-69ec-4ce7-8ee4-2fe52dc6de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Volume 5c0eff3f-35ad-43a1-827c-67d6f88d63d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4', 'volume_size': 1}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1269467253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0eff3f-35ad-43a1-827c-67d6f88d63d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4832bcdf027f487d892cd7feac690214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:07Z,use_quota=True,user_id='7fc6b774c7f147b18a8ea604d6cc30bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Creating volume 5c0eff3f-35ad-43a1-827c-67d6f88d63d4 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:47:07 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:07 devstack sudo[104593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 1073741824
Nov 07 02:47:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-90ca3708-da7f-4aaa-a328-b1938ea2ca42 tempest-GroupsV320Test-716355651 None] Group tempest-GroupsV320Test-Group-1876367670: created successfully
Nov 07 02:47:07 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-90ca3708-da7f-4aaa-a328-b1938ea2ca42 tempest-GroupsV320Test-716355651 None] Create group completed successfully.
Nov 07 02:47:07 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 1073741824" returned: 0 in 0.422s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:07 devstack sudo[104599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4
Nov 07 02:47:07 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:07 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" returned: 0 in 0.267s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367a010f-69ec-4ce7-8ee4-2fe52dc6de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2b4ca6-c7c0-4ddf-9dc1-055c05dbf7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Volume volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 (5c0eff3f-35ad-43a1-827c-67d6f88d63d4): created successfully
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2b4ca6-c7c0-4ddf-9dc1-055c05dbf7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Flow 'volume_create_manager' (f7ebafb5-73d4-41df-90a6-6d5103154f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-17cfabc7-0517-4c17-8d82-7a9fcdb99bf0 tempest-SnapshotDependencyTests-428136740 None] Created volume successfully.
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9cfe5e0b-695b-4f5a-ab96-36f887b81730 tempest-GroupsV320Test-716355651 None] Created reservations ['97860a29-874d-470f-9288-d36afd69a06e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Flow 'volume_create_manager' (3eb4ae51-04a1-4aa0-9b41-690020d14d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d438c3-8b4d-482f-9d9d-5519380cd3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9cfe5e0b-695b-4f5a-ab96-36f887b81730 tempest-GroupsV320Test-716355651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9cfe5e0b-695b-4f5a-ab96-36f887b81730 tempest-GroupsV320Test-716355651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9cfe5e0b-695b-4f5a-ab96-36f887b81730 tempest-GroupsV320Test-716355651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9cfe5e0b-695b-4f5a-ab96-36f887b81730 tempest-GroupsV320Test-716355651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9cfe5e0b-695b-4f5a-ab96-36f887b81730 tempest-GroupsV320Test-716355651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9cfe5e0b-695b-4f5a-ab96-36f887b81730 tempest-GroupsV320Test-716355651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d438c3-8b4d-482f-9d9d-5519380cd3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92b5e4a3b0941b094693cbc646c168f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:09Z,use_quota=True,user_id='e04d2e6fa16f4d9aa122a0f2300acf78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:08 devstack sudo[104603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:08 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c942efc-c190-4c1c-b87d-972c3804217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c942efc-c190-4c1c-b87d-972c3804217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0d282-e09b-4001-968e-ee6c51a26291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0d282-e09b-4001-968e-ee6c51a26291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26', 'volume_name': 'volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f29c30-3422-45c0-8f79-557aad74436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f29c30-3422-45c0-8f79-557aad74436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb117aae-6209-4eb3-9e52-8b576b7eb673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Volume 5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26', 'volume_size': 1}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92b5e4a3b0941b094693cbc646c168f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:09Z,use_quota=True,user_id='e04d2e6fa16f4d9aa122a0f2300acf78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Creating volume 5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:47:08 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:08 devstack sudo[104605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26 1073741824
Nov 07 02:47:08 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:08 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9cfe5e0b-695b-4f5a-ab96-36f887b81730 tempest-GroupsV320Test-716355651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.272s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:08 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-9cfe5e0b-695b-4f5a-ab96-36f887b81730 tempest-GroupsV320Test-716355651 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9cfe5e0b-695b-4f5a-ab96-36f887b81730 tempest-GroupsV320Test-716355651 None] Delete group completed successfully.
Nov 07 02:47:09 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26 1073741824" returned: 0 in 0.462s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:09 devstack sudo[104612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26
Nov 07 02:47:09 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:09 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26" returned: 0 in 0.258s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.125s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] Creating offline snapshot f4ce937b-fa6c-4eab-b51c-757345960b1e of volume 5c0eff3f-35ad-43a1-827c-67d6f88d63d4 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb117aae-6209-4eb3-9e52-8b576b7eb673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbf9a4e-5192-40f6-b7dc-a0cfddfbc9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaefa7dd-87b3-4a60-9879-6b602ce96194]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Volume volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26 (5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26): created successfully
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbf9a4e-5192-40f6-b7dc-a0cfddfbc9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Flow 'volume_create_manager' (3eb4ae51-04a1-4aa0-9b41-690020d14d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-db176524-eacf-4575-9fa4-ac67a7446eb9 tempest-CinderUnicodeTest-1865765997 None] Created volume successfully.
Nov 07 02:47:09 devstack sudo[104615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4
Nov 07 02:47:09 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:09 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:10 devstack sudo[104621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e 1G
Nov 07 02:47:10 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:10 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e 1G" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:10 devstack sudo[104627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e
Nov 07 02:47:10 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:10 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e" returned: 0 in 0.339s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:10 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e is being set with open permissions: ugo+rw
Nov 07 02:47:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:10 devstack sudo[104632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e
Nov 07 02:47:10 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:11 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e" returned: 0 in 0.300s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:11 devstack sudo[104635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.info
Nov 07 02:47:11 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Flow 'volume_create_manager' (0b01a118-0480-45e8-8a3d-47e6f2dd31ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de246bfa-eba9-483c-ac2c-5dda7d205fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de246bfa-eba9-483c-ac2c-5dda7d205fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1234499515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800b9d79-9530-4589-9887-c776a3562b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92b5e4a3b0941b094693cbc646c168f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:11Z,use_quota=True,user_id='e04d2e6fa16f4d9aa122a0f2300acf78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:11 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781857fa-d4c6-487f-a263-adf3f3a1e4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781857fa-d4c6-487f-a263-adf3f3a1e4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae2f859-85bb-4086-b5cc-2809f5fa1081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae2f859-85bb-4086-b5cc-2809f5fa1081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800b9d79-9530-4589-9887-c776a3562b20', 'volume_name': 'volume-800b9d79-9530-4589-9887-c776a3562b20', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b07f28-32b9-44bc-8005-5db82c2ac352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b07f28-32b9-44bc-8005-5db82c2ac352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba265f5-c7a0-4a67-bfe2-c4f4e4af301b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Volume 800b9d79-9530-4589-9887-c776a3562b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800b9d79-9530-4589-9887-c776a3562b20', 'volume_size': 1}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.info" returned: 0 in 0.336s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:11 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.info is being set with open permissions: ugo+rw
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:11 devstack sudo[104638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.info
Nov 07 02:47:11 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:11 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.info" returned: 0 in 0.261s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1234499515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800b9d79-9530-4589-9887-c776a3562b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92b5e4a3b0941b094693cbc646c168f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:11Z,use_quota=True,user_id='e04d2e6fa16f4d9aa122a0f2300acf78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Creating volume 800b9d79-9530-4589-9887-c776a3562b20 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:47:11 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:47:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:11 devstack sudo[104641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20 1073741824
Nov 07 02:47:11 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b3ec4fa6-afd0-4c77-b191-004095fec7d8 tempest-SnapshotDependencyTests-428136740 None] Create snapshot completed successfully
Nov 07 02:47:12 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20 1073741824" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:12 devstack sudo[104647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20
Nov 07 02:47:12 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:12 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20" returned: 0 in 0.270s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:47:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba265f5-c7a0-4a67-bfe2-c4f4e4af301b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800b9d79-9530-4589-9887-c776a3562b20', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595f284f-de7c-46f2-af8e-c841d89a7519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Volume volume-800b9d79-9530-4589-9887-c776a3562b20 (800b9d79-9530-4589-9887-c776a3562b20): created successfully
Nov 07 02:47:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595f284f-de7c-46f2-af8e-c841d89a7519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Flow 'volume_create_manager' (0b01a118-0480-45e8-8a3d-47e6f2dd31ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-54407917-0951-4497-9a4f-74e1cee87d4b tempest-CinderUnicodeTest-1865765997 None] Created volume successfully.
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Flow 'volume_create_manager' (299df933-be09-4050-afaf-9494817f5f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cc3bb5-cb35-4d73-b9e4-0b175cb38d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cc3bb5-cb35-4d73-b9e4-0b175cb38d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4531e0-4b1f-426a-8dab-03c39d4a8cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4832bcdf027f487d892cd7feac690214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f4ce937b-fa6c-4eab-b51c-757345960b1e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:13Z,use_quota=True,user_id='7fc6b774c7f147b18a8ea604d6cc30bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23356c19-6550-4d0a-ad03-c34b32c9a910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23356c19-6550-4d0a-ad03-c34b32c9a910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ecc3f1-e3b0-4ee6-a4ed-9814ead22a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ecc3f1-e3b0-4ee6-a4ed-9814ead22a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed4531e0-4b1f-426a-8dab-03c39d4a8cfe', 'volume_name': 'volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe', 'volume_size': 1, 'snapshot_id': 'f4ce937b-fa6c-4eab-b51c-757345960b1e'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac060408-7438-4bbe-8bfc-ac780c6ae50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac060408-7438-4bbe-8bfc-ac780c6ae50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00372c9a-c1e6-4c9b-97e8-7ff2ef786477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Volume ed4531e0-4b1f-426a-8dab-03c39d4a8cfe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe', 'volume_size': 1, 'snapshot_id': 'f4ce937b-fa6c-4eab-b51c-757345960b1e'}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "cinder-quobyte-f4ce937b-fa6c-4eab-b51c-757345960b1e-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-f4ce937b-fa6c-4eab-b51c-757345960b1e-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Creating volume ed4531e0-4b1f-426a-8dab-03c39d4a8cfe from snapshot f4ce937b-fa6c-4eab-b51c-757345960b1e {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "cinder-quobyte-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] snapshot: f4ce937b-fa6c-4eab-b51c-757345960b1e, volume: ed4531e0-4b1f-426a-8dab-03c39d4a8cfe,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0f07b2-51ea-4c3b-a9e6-89ceddfbbe1b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:13 devstack sudo[104650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e
Nov 07 02:47:13 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:13 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e" returned: 0 in 0.431s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4a3498-c4f7-4d30-b662-cc64e6c5d9ef]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:13 devstack sudo[104655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4
Nov 07 02:47:13 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:14 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" returned: 0 in 0.400s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:47:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:47:14 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:47:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:14 devstack sudo[104661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe
Nov 07 02:47:14 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:21 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" returned: 0 in 7.004s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:47:21 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Converted 1024.00 MB image at 146.19 MB/s
Nov 07 02:47:21 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe is being set with open permissions: ugo+rw
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:21 devstack sudo[104676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe
Nov 07 02:47:21 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:21 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" released by "_copy_volume_from_snapshot" :: held 8.187s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-f4ce937b-fa6c-4eab-b51c-757345960b1e-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" released by "_create_volume_from_snapshot" :: held 8.249s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.266s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.853s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] Creating offline snapshot 72777c97-31e5-4903-b300-cd05b31d5cfc of volume 800b9d79-9530-4589-9887-c776a3562b20 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00372c9a-c1e6-4c9b-97e8-7ff2ef786477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe', 'volume_size': 1, 'snapshot_id': 'f4ce937b-fa6c-4eab-b51c-757345960b1e'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aebc1b1-00c2-4287-92cd-856cb84d73e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b20bece-3022-40ac-b283-1f865f43cc02]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Volume volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe (ed4531e0-4b1f-426a-8dab-03c39d4a8cfe): created successfully
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aebc1b1-00c2-4287-92cd-856cb84d73e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Flow 'volume_create_manager' (299df933-be09-4050-afaf-9494817f5f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3ef0e592-127d-4630-a99c-e44468d4c938 tempest-SnapshotDependencyTests-428136740 None] Created volume successfully.
Nov 07 02:47:21 devstack sudo[104679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20
Nov 07 02:47:21 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:22 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20" returned: 0 in 0.441s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:22 devstack sudo[104684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc 1G
Nov 07 02:47:22 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "cinder-f4ce937b-fa6c-4eab-b51c-757345960b1e-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-f4ce937b-fa6c-4eab-b51c-757345960b1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "cinder-quobyte-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "cinder-quobyte-f4ce937b-fa6c-4eab-b51c-757345960b1e" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-f4ce937b-fa6c-4eab-b51c-757345960b1e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Deleting offline snapshot f4ce937b-fa6c-4eab-b51c-757345960b1e of volume 5c0eff3f-35ad-43a1-827c-67d6f88d63d4 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] snapshot_file for this snap is: volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fef1ef9-edb0-4561-a1a1-369516516876]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:22 devstack sudo[104686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e
Nov 07 02:47:22 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:22 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc 1G" returned: 0 in 0.462s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800b9d79-9530-4589-9887-c776a3562b20 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:22 devstack sudo[104694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800b9d79-9530-4589-9887-c776a3562b20 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc
Nov 07 02:47:22 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:22 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e" returned: 0 in 0.397s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fe551f-3a76-441a-bbb9-f0d2f578914f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:22 devstack sudo[104697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4
Nov 07 02:47:22 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:22 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800b9d79-9530-4589-9887-c776a3562b20 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc" returned: 0 in 0.319s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:22 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc is being set with open permissions: ugo+rw
Nov 07 02:47:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:22 devstack sudo[104703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc
Nov 07 02:47:22 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:23 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc" returned: 0 in 0.271s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:23 devstack sudo[104708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.info
Nov 07 02:47:23 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:23 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" returned: 0 in 0.612s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:23 devstack sudo[104712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e
Nov 07 02:47:23 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:23 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.info" returned: 0 in 0.290s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:23 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.info is being set with open permissions: ugo+rw
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:23 devstack sudo[104715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.info
Nov 07 02:47:23 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:23 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e" returned: 0 in 0.364s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:23 devstack sudo[104720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e
Nov 07 02:47:23 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:23 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.info" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-df20df28-a174-4d84-bc63-fa9087f9612b tempest-CinderUnicodeTest-1865765997 None] Create snapshot completed successfully
Nov 07 02:47:23 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4.f4ce937b-fa6c-4eab-b51c-757345960b1e" returned: 0 in 0.289s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-f4ce937b-fa6c-4eab-b51c-757345960b1e" released by "_delete_snapshot" :: held 1.773s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" released by "delete_snapshot" :: held 1.800s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Created reservations ['ce28cbd4-d295-45a7-9310-a22185643d95', 'ddf9b1a4-67ab-4390-ad67-30b77a2b1764', 'f04db27d-0b0b-4381-b6d8-4b34c6590da6', '70dd0235-1bc5-48b9-a351-03b59f9d1185'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Delete snapshot completed successfully.
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-977f4ee5-cd67-4764-89f2-e475d9277079 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-f4ce937b-fa6c-4eab-b51c-757345960b1e-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "cinder-5c0eff3f-35ad-43a1-827c-67d6f88d63d4-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-5c0eff3f-35ad-43a1-827c-67d6f88d63d4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "cinder-quobyte-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "cinder-72777c97-31e5-4903-b300-cd05b31d5cfc-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-72777c97-31e5-4903-b300-cd05b31d5cfc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "cinder-quobyte-800b9d79-9530-4589-9887-c776a3562b20" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[05102b7d-f60b-4219-ae8d-08c994eb9abb]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-quobyte-800b9d79-9530-4589-9887-c776a3562b20" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "cinder-quobyte-72777c97-31e5-4903-b300-cd05b31d5cfc" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-quobyte-72777c97-31e5-4903-b300-cd05b31d5cfc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Deleting offline snapshot 72777c97-31e5-4903-b300-cd05b31d5cfc of volume 800b9d79-9530-4589-9887-c776a3562b20 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] snapshot_file for this snap is: volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb5861a-ea52-4b56-af5e-8394ddc7f201]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:24 devstack sudo[104724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4
Nov 07 02:47:24 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:24 devstack sudo[104725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc
Nov 07 02:47:24 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:24 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" returned: 0 in 0.411s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:24 devstack sudo[104734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4
Nov 07 02:47:24 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:24 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc" returned: 0 in 0.411s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800b9d79-9530-4589-9887-c776a3562b20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e8147f-056d-49a5-b482-9b8dd952aed4]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:25 devstack sudo[104737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20
Nov 07 02:47:25 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:25 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" returned: 0 in 0.271s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-5c0eff3f-35ad-43a1-827c-67d6f88d63d4" released by "delete_volume" :: held 0.779s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Created reservations ['09deaf78-10cb-451a-82e9-ed2f92580455', '4657d317-a089-4593-b13a-cab7101b2909', '89d1466c-b997-426b-8a0a-7eb35c00fa44', 'e93725b5-2d93-4207-9799-56f728a5faad'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:25 devstack sudo[104740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:25 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:25 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20" returned: 0 in 0.486s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "cinder-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:25 devstack sudo[104745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc
Nov 07 02:47:25 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "cinder-quobyte-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a45c1-f10d-4bfb-be65-1b3ee8e52b09]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:25 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.360s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Deleted volume successfully.
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9c7b57bd-6cdb-4872-abe2-cb7e097451a9 tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-5c0eff3f-35ad-43a1-827c-67d6f88d63d4-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:25 devstack sudo[104748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe
Nov 07 02:47:25 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:25 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc" returned: 0 in 0.426s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:25 devstack sudo[104754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc
Nov 07 02:47:25 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:26 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" returned: 0 in 0.450s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:26 devstack sudo[104759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe
Nov 07 02:47:26 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:26 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20.72777c97-31e5-4903-b300-cd05b31d5cfc" returned: 0 in 0.286s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-quobyte-72777c97-31e5-4903-b300-cd05b31d5cfc" released by "_delete_snapshot" :: held 1.760s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-quobyte-800b9d79-9530-4589-9887-c776a3562b20" released by "delete_snapshot" :: held 1.785s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Created reservations ['febffa14-d658-41da-9c9f-9ca4a42633d2', '26731842-04ba-4a37-8bac-deec83710133', '7f9e6208-72b3-4ee5-a82c-252cff00d211', 'c30d5a05-e5ce-4f1e-8766-dd4d9d227e4e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:26 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" returned: 0 in 0.288s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-quobyte-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe" released by "delete_volume" :: held 0.799s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Delete snapshot completed successfully.
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27516ea4-9dc3-4910-a134-125fd00d4f82 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-72777c97-31e5-4903-b300-cd05b31d5cfc-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Flow 'volume_create_manager' (34ae7ef7-10c0-42e4-8932-336b788f605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d41eb7-e922-4c7a-bb48-e49d2532c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d41eb7-e922-4c7a-bb48-e49d2532c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1742739614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb37916e-c925-4d3e-8187-388bdedc2611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af46aaa891f449aac068b62d83a0e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:26Z,use_quota=True,user_id='6ee740d320e54db7bc6236204b44d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cb3ee5-1b28-4bb8-8765-d674fff5f82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cb3ee5-1b28-4bb8-8765-d674fff5f82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2274593b-a388-4393-80e9-76ce92046f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2274593b-a388-4393-80e9-76ce92046f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb37916e-c925-4d3e-8187-388bdedc2611', 'volume_name': 'volume-cb37916e-c925-4d3e-8187-388bdedc2611', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02621452-89ad-4e51-8035-0b64264078e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02621452-89ad-4e51-8035-0b64264078e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41650de1-8c11-41b2-b066-9c5b4f28f494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Volume cb37916e-c925-4d3e-8187-388bdedc2611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb37916e-c925-4d3e-8187-388bdedc2611', 'volume_size': 1}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1742739614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb37916e-c925-4d3e-8187-388bdedc2611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af46aaa891f449aac068b62d83a0e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:26Z,use_quota=True,user_id='6ee740d320e54db7bc6236204b44d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Creating volume cb37916e-c925-4d3e-8187-388bdedc2611 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:47:26 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "cinder-800b9d79-9530-4589-9887-c776a3562b20-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:26 devstack sudo[104763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611 1073741824
Nov 07 02:47:26 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-800b9d79-9530-4589-9887-c776a3562b20-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Created reservations ['63b74860-cdd4-4b8e-91dc-66da15c3227c', '000ca98f-9b90-4218-8dd9-85c1e086202c', 'fcb39d6d-c976-4aa0-aa22-9ec3371913fa', '4505e2c8-7877-4113-85b9-1b506ea3d67a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "cinder-quobyte-800b9d79-9530-4589-9887-c776a3562b20" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-quobyte-800b9d79-9530-4589-9887-c776a3562b20" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[545e8c77-576f-4ec9-ba3a-7b8b74e1b114]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:26 devstack sudo[104765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:26 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:26 devstack sudo[104766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20
Nov 07 02:47:26 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:27 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:27 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611 1073741824" returned: 0 in 0.484s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Deleted volume successfully.
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-74380678-663a-4fa5-a7cb-4d84ecb1203c tempest-SnapshotDependencyTests-428136740 None] Lock "cinder-ed4531e0-4b1f-426a-8dab-03c39d4a8cfe-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:27 devstack sudo[104774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611
Nov 07 02:47:27 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:27 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:27 devstack sudo[104779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20
Nov 07 02:47:27 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:27 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611" returned: 0 in 0.270s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41650de1-8c11-41b2-b066-9c5b4f28f494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb37916e-c925-4d3e-8187-388bdedc2611', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a46e5df-2674-4b9e-9990-2cb552a7ee12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Volume volume-cb37916e-c925-4d3e-8187-388bdedc2611 (cb37916e-c925-4d3e-8187-388bdedc2611): created successfully
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a46e5df-2674-4b9e-9990-2cb552a7ee12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Flow 'volume_create_manager' (34ae7ef7-10c0-42e4-8932-336b788f605d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-aefbd791-1aae-4407-8e6a-a8260f8b142f tempest-VolumeQuotasAdminTestJSON-1668290340 None] Created volume successfully.
Nov 07 02:47:27 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800b9d79-9530-4589-9887-c776a3562b20" returned: 0 in 0.260s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-quobyte-800b9d79-9530-4589-9887-c776a3562b20" released by "delete_volume" :: held 0.746s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Created reservations ['0e2f8e7f-1c12-46ee-bd9f-890b0be00d81', 'fb23b83e-29ef-4b88-bee2-40d40b92d85d', '9b969795-41dc-42d0-8178-e47d6011b483', 'ec1d4ddb-95e4-4676-ac6a-8e80178aca67'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:27 devstack sudo[104783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:27 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "cinder-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:27 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.270s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "cinder-quobyte-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Deleted volume successfully.
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-quobyte-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72fd3143-8b82-4262-935e-f7d3e7bb8bc4 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-800b9d79-9530-4589-9887-c776a3562b20-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[26942df7-30b8-4211-97bf-3fefc666bf24]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:27 devstack sudo[104786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26
Nov 07 02:47:27 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:28 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:28 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26
Nov 07 02:47:28 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:28 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26" returned: 0 in 0.254s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-quobyte-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26" released by "delete_volume" :: held 0.688s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Acquiring lock "cinder-cb37916e-c925-4d3e-8187-388bdedc2611-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "cinder-cb37916e-c925-4d3e-8187-388bdedc2611-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Acquiring lock "cinder-quobyte-cb37916e-c925-4d3e-8187-388bdedc2611" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Created reservations ['00f114e5-7558-4bdf-bdf1-25ed993c5db5', '3963051b-836a-4c45-a14e-92529ccd64ce', 'df1fd78e-50f2-408f-a6de-8f2c33b04d1d', '754398e7-8e3d-4537-88cf-129fc04ae833'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "cinder-quobyte-cb37916e-c925-4d3e-8187-388bdedc2611" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6a4cd4-9df2-4112-8a91-125b6080f841]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:28 devstack sudo[104798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:28 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:28 devstack sudo[104797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611
Nov 07 02:47:28 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:29 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.321s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Deleted volume successfully.
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-52c62cd6-55b7-4234-82b6-d6714ad02cc8 tempest-CinderUnicodeTest-1865765997 None] Lock "cinder-5a8f4d0d-6cac-4bda-86f6-0e2dc7443a26-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:29 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611" returned: 0 in 0.496s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:29 devstack sudo[104805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611
Nov 07 02:47:29 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:29 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cb37916e-c925-4d3e-8187-388bdedc2611" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "cinder-quobyte-cb37916e-c925-4d3e-8187-388bdedc2611" released by "delete_volume" :: held 0.863s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Created reservations ['244f44b8-3f83-474a-b90d-2b6533368ea8', '23f424fc-5b75-474d-99e8-fc12138f7010', '34c09534-5f0e-4734-ad4e-4c29633a98e0', 'bbce65a3-04ce-496e-a03a-b7d43f05b204'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:29 devstack sudo[104809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:29 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:30 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.363s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Deleted volume successfully.
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c794b28d-ce96-4497-951c-4bf86a45c8be tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "cinder-cb37916e-c925-4d3e-8187-388bdedc2611-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Flow 'volume_create_manager' (6aae902a-4ed7-437d-93d7-6737ed17da6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22b1292-bda7-440c-b6ab-d2370e429ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22b1292-bda7-440c-b6ab-d2370e429ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1424426230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b96ca4-110f-4087-b076-42ef6348daae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af46aaa891f449aac068b62d83a0e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:30Z,use_quota=True,user_id='6ee740d320e54db7bc6236204b44d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6706c0fa-6735-40b7-8cc9-4fe5bfd7d703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6706c0fa-6735-40b7-8cc9-4fe5bfd7d703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56382b69-09d9-4c1a-a97a-626208d4dfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56382b69-09d9-4c1a-a97a-626208d4dfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b96ca4-110f-4087-b076-42ef6348daae', 'volume_name': 'volume-f5b96ca4-110f-4087-b076-42ef6348daae', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056f035d-1e4c-4af2-999e-ee6d0eba2b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056f035d-1e4c-4af2-999e-ee6d0eba2b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8166ec03-ec4d-4b26-a71d-b4ba25e0c4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Volume f5b96ca4-110f-4087-b076-42ef6348daae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b96ca4-110f-4087-b076-42ef6348daae', 'volume_size': 1}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1424426230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b96ca4-110f-4087-b076-42ef6348daae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0af46aaa891f449aac068b62d83a0e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:30Z,use_quota=True,user_id='6ee740d320e54db7bc6236204b44d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Creating volume f5b96ca4-110f-4087-b076-42ef6348daae {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:47:30 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:47:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:30 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae 1073741824
Nov 07 02:47:30 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:31 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae 1073741824" returned: 0 in 0.516s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:31 devstack sudo[104818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae
Nov 07 02:47:31 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:31 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae" returned: 0 in 0.272s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:47:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8166ec03-ec4d-4b26-a71d-b4ba25e0c4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b96ca4-110f-4087-b076-42ef6348daae', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0126a689-1f0b-4308-bcf1-fc132aee2a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:31 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Volume volume-f5b96ca4-110f-4087-b076-42ef6348daae (f5b96ca4-110f-4087-b076-42ef6348daae): created successfully
Nov 07 02:47:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0126a689-1f0b-4308-bcf1-fc132aee2a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Flow 'volume_create_manager' (6aae902a-4ed7-437d-93d7-6737ed17da6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b936b2a0-625c-4378-a16e-f4f8844d119b tempest-VolumeQuotasAdminTestJSON-1668290340 None] Created volume successfully.
Nov 07 02:47:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-53a3663b-4740-4053-af99-ee28d393bda1 tempest-VolumeQuotasAdminTestJSON-559038638 None] Transfer volume completed successfully.
Nov 07 02:47:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Acquiring lock "cinder-f5b96ca4-110f-4087-b076-42ef6348daae-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Lock "cinder-f5b96ca4-110f-4087-b076-42ef6348daae-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Acquiring lock "cinder-quobyte-f5b96ca4-110f-4087-b076-42ef6348daae" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Lock "cinder-quobyte-f5b96ca4-110f-4087-b076-42ef6348daae" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d643e3e7-e28f-406e-9522-d2e1252ec5e7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:34 devstack sudo[104822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae
Nov 07 02:47:34 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:34 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae" returned: 0 in 0.392s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:34 devstack sudo[104827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae
Nov 07 02:47:34 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:34 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f5b96ca4-110f-4087-b076-42ef6348daae" returned: 0 in 0.286s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Lock "cinder-quobyte-f5b96ca4-110f-4087-b076-42ef6348daae" released by "delete_volume" :: held 0.732s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Created reservations ['47e87537-cf5e-4da2-83de-9ad4c382bc19', '60bfff47-ca42-453b-b465-dcb09168af49', '2c82308f-58b9-48fe-befa-6abfe8e18702', 'cd95f536-31ce-4614-93b8-7e4a18afc9fc'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:34 devstack sudo[104831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:34 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:35 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.338s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Deleted volume successfully.
Nov 07 02:47:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8b570ea7-2c4d-4f34-a1b3-117257dc48d4 tempest-VolumeQuotasAdminTestJSON-972387052 None] Lock "cinder-f5b96ca4-110f-4087-b076-42ef6348daae-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Flow 'volume_create_manager' (66a99f41-35ae-4bd3-a7de-33fd20c5f5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a746cb-fcec-4b98-a6bb-7d4d1b419fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a746cb-fcec-4b98-a6bb-7d4d1b419fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1582747488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cab11c-801c-494f-88b5-644fa83254c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3907dbab9c1d4e5babc7a7829bfc863d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:43Z,use_quota=True,user_id='20aeb180343a4bec9c5be8edb2e2e3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fea2325-37bb-47c3-bcc6-7a47fea520aa),volume_type_id=9fea2325-37bb-47c3-bcc6-7a47fea520aa)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2080a4-52a4-4e2c-b12f-c33c3fd4c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2080a4-52a4-4e2c-b12f-c33c3fd4c13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b9a0d9-b387-4f53-a6ff-af4cd4a5055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b9a0d9-b387-4f53-a6ff-af4cd4a5055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00cab11c-801c-494f-88b5-644fa83254c1', 'volume_name': 'volume-00cab11c-801c-494f-88b5-644fa83254c1', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643eaadc-39a9-4670-ad16-d8dffe4cf5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643eaadc-39a9-4670-ad16-d8dffe4cf5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb18b6b0-d62a-4285-bee0-5647d57350b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Volume 00cab11c-801c-494f-88b5-644fa83254c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00cab11c-801c-494f-88b5-644fa83254c1', 'volume_size': 1}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1582747488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cab11c-801c-494f-88b5-644fa83254c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3907dbab9c1d4e5babc7a7829bfc863d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:43Z,use_quota=True,user_id='20aeb180343a4bec9c5be8edb2e2e3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fea2325-37bb-47c3-bcc6-7a47fea520aa),volume_type_id=9fea2325-37bb-47c3-bcc6-7a47fea520aa)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Creating volume 00cab11c-801c-494f-88b5-644fa83254c1 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:47:42 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:47:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:42 devstack sudo[104872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1 1073741824
Nov 07 02:47:42 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:43 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1 1073741824" returned: 0 in 0.408s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:43 devstack sudo[104877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1
Nov 07 02:47:43 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:43 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1" returned: 0 in 0.244s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:47:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb18b6b0-d62a-4285-bee0-5647d57350b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00cab11c-801c-494f-88b5-644fa83254c1', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52e9205-16fc-4c40-87f7-9b57a5ee940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:43 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Volume volume-00cab11c-801c-494f-88b5-644fa83254c1 (00cab11c-801c-494f-88b5-644fa83254c1): created successfully
Nov 07 02:47:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52e9205-16fc-4c40-87f7-9b57a5ee940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Flow 'volume_create_manager' (66a99f41-35ae-4bd3-a7de-33fd20c5f5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-bb98d064-f250-43ae-b992-a1a364056ced tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Created volume successfully.
Nov 07 02:47:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1b4358f5-ca4f-4318-8082-d6ce80d48800 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1b4358f5-ca4f-4318-8082-d6ce80d48800 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1b4358f5-ca4f-4318-8082-d6ce80d48800 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1b4358f5-ca4f-4318-8082-d6ce80d48800 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1b4358f5-ca4f-4318-8082-d6ce80d48800 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1b4358f5-ca4f-4318-8082-d6ce80d48800 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:44 devstack sudo[104881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:44 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:44 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1b4358f5-ca4f-4318-8082-d6ce80d48800 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.241s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:44 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-1b4358f5-ca4f-4318-8082-d6ce80d48800 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1b4358f5-ca4f-4318-8082-d6ce80d48800 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Retype volume completed successfully.
Nov 07 02:47:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Acquiring lock "cinder-00cab11c-801c-494f-88b5-644fa83254c1-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "cinder-00cab11c-801c-494f-88b5-644fa83254c1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Acquiring lock "cinder-quobyte-00cab11c-801c-494f-88b5-644fa83254c1" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "cinder-quobyte-00cab11c-801c-494f-88b5-644fa83254c1" acquired by "delete_volume" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[622d853b-2873-4a0d-8af5-a3913e79b0bb]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:45 devstack sudo[104884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1
Nov 07 02:47:45 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:45 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:45 devstack sudo[104889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1
Nov 07 02:47:45 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:45 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-00cab11c-801c-494f-88b5-644fa83254c1" returned: 0 in 0.247s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "cinder-quobyte-00cab11c-801c-494f-88b5-644fa83254c1" released by "delete_volume" :: held 0.637s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:46 devstack cinder-volume[87087]: WARNING cinder.quota [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:47:46 devstack cinder-volume[87087]: WARNING cinder.quota [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:47:46 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Created reservations ['40a0414c-3ebb-40ff-bbe5-9aa7308e1f04', 'b31407bc-7160-4ae2-8621-05fb2d28f579', 'd786f16b-8bc7-48ae-bb69-00c420ad62cb', 'c346993d-9b27-47bf-9486-2b68d5134fe7'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:46 devstack sudo[104892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:46 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:46 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.238s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:46 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Deleted volume successfully.
Nov 07 02:47:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5405d73f-bfd6-4154-bf64-9b36d2be6b33 tempest-VolumeRetypeWithoutMigrationTest-839455741 None] Lock "cinder-00cab11c-801c-494f-88b5-644fa83254c1-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Flow 'volume_create_manager' (45be89a6-7934-41d3-abb7-204d2b9be450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91d76bc-d85a-49fa-9f69-351e299a7061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91d76bc-d85a-49fa-9f69-351e299a7061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-472868908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397d6899-bf1a-4d1f-b2a8-45b92b6ca21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f7c2c0cbd2d48a186335afafd406b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:52Z,use_quota=True,user_id='59bd3816fd7d4a06bf3044e32cc9de1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68fd74d9-6e3e-4557-b32b-3423a93d9124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68fd74d9-6e3e-4557-b32b-3423a93d9124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f041dc68-2e1b-41fc-a867-fc376ea4c543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f041dc68-2e1b-41fc-a867-fc376ea4c543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '397d6899-bf1a-4d1f-b2a8-45b92b6ca21c', 'volume_name': 'volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96431b92-b1df-4043-8f8b-7ee6ac2d98d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96431b92-b1df-4043-8f8b-7ee6ac2d98d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36b4474-96ff-4b7c-a509-3faaa4bb8ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:51 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Volume 397d6899-bf1a-4d1f-b2a8-45b92b6ca21c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c', 'volume_size': 1}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-472868908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397d6899-bf1a-4d1f-b2a8-45b92b6ca21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f7c2c0cbd2d48a186335afafd406b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:52Z,use_quota=True,user_id='59bd3816fd7d4a06bf3044e32cc9de1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Creating volume 397d6899-bf1a-4d1f-b2a8-45b92b6ca21c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:47:51 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:47:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:51 devstack sudo[104902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c 1073741824
Nov 07 02:47:51 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:52 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c 1073741824" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:52 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=132,cinder:SELECT=116,cinder:INSERT=37,cinder:DELETE=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:47:52 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=142,cinder:SELECT=113,cinder:INSERT=33,cinder:DELETE=11 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:47:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:52 devstack sudo[104907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c
Nov 07 02:47:52 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:52 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c" returned: 0 in 0.248s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:47:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36b4474-96ff-4b7c-a509-3faaa4bb8ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0b2e61-0798-4773-9dff-b025237cd71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:52 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Volume volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c (397d6899-bf1a-4d1f-b2a8-45b92b6ca21c): created successfully
Nov 07 02:47:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0b2e61-0798-4773-9dff-b025237cd71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Flow 'volume_create_manager' (45be89a6-7934-41d3-abb7-204d2b9be450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6be01186-39cf-4232-a139-3510e713da72 tempest-VolumesServicesTestJSON-1236597744 None] Created volume successfully.
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Acquiring lock "cinder-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Lock "cinder-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Acquiring lock "cinder-quobyte-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Lock "cinder-quobyte-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1805be58-9b18-49fb-b089-912bb8c5bb5b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:53 devstack sudo[104910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c
Nov 07 02:47:53 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:53 devstack sudo[104914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:53 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:53 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c" returned: 0 in 0.378s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:53 devstack sudo[104917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c
Nov 07 02:47:53 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:53 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.257s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:47:53 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c" returned: 0 in 0.264s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Lock "cinder-quobyte-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c" released by "delete_volume" :: held 0.681s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Created reservations ['dc40da03-0093-4f9c-835f-ac16f497c15a', '5178f5a3-06cd-4ccd-a1da-577bc5dabdb8', 'd3dec60e-d544-4a70-9098-fcb11b8d4456', '33324cd3-e830-4804-87ed-f55a397753ad'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:53 devstack sudo[104921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:47:53 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:54 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.248s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:54 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Deleted volume successfully.
Nov 07 02:47:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00751628-263b-4042-9ccd-2eb6afa46a04 tempest-VolumesServicesTestJSON-1236597744 None] Lock "cinder-397d6899-bf1a-4d1f-b2a8-45b92b6ca21c-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:03 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=12,cinder:DELETE=1,cinder:SELECT=4,cinder:INSERT=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:48:04 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Flow 'volume_create_manager' (845bac00-bc69-415b-a500-18d030cccb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7572b1a3-5cbf-45b8-9b00-c33df8b26c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7572b1a3-5cbf-45b8-9b00-c33df8b26c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1881495317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cdb509-2ba4-4652-953d-6ee164eb0643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91143a06d87446668bd631522d83e5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:08Z,use_quota=True,user_id='e424f29b0060482ab726b4dd4a0eec1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcdf71b-5cd8-49c0-bbe6-6d0f534ce860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcdf71b-5cd8-49c0-bbe6-6d0f534ce860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cc5fd6-58d8-49d3-9d81-f6e91c315fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cc5fd6-58d8-49d3-9d81-f6e91c315fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0cdb509-2ba4-4652-953d-6ee164eb0643', 'volume_name': 'volume-d0cdb509-2ba4-4652-953d-6ee164eb0643', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1605e1-9703-4e49-b09c-2913c5bd2a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1605e1-9703-4e49-b09c-2913c5bd2a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45991c6-95a9-48c0-a06b-ddc2dad7dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Volume d0cdb509-2ba4-4652-953d-6ee164eb0643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0cdb509-2ba4-4652-953d-6ee164eb0643', 'volume_size': 1}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1881495317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cdb509-2ba4-4652-953d-6ee164eb0643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91143a06d87446668bd631522d83e5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:08Z,use_quota=True,user_id='e424f29b0060482ab726b4dd4a0eec1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Creating volume d0cdb509-2ba4-4652-953d-6ee164eb0643 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:48:08 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:08 devstack sudo[104927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643 1073741824
Nov 07 02:48:08 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:08 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643 1073741824" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:08 devstack sudo[104933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643
Nov 07 02:48:08 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:09 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643" returned: 0 in 0.247s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:48:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45991c6-95a9-48c0-a06b-ddc2dad7dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0cdb509-2ba4-4652-953d-6ee164eb0643', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e7ab77-23f6-4dc3-8fca-f8d2d23137b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Volume volume-d0cdb509-2ba4-4652-953d-6ee164eb0643 (d0cdb509-2ba4-4652-953d-6ee164eb0643): created successfully
Nov 07 02:48:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e7ab77-23f6-4dc3-8fca-f8d2d23137b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Flow 'volume_create_manager' (845bac00-bc69-415b-a500-18d030cccb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dfc2d7c6-efd5-47f5-ae4c-0236da51458f tempest-VolumesTransfersV355Test-1236583286 None] Created volume successfully.
Nov 07 02:48:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4041fb32-306f-468b-afe7-81766084318b tempest-VolumesTransfersV355Test-990488327 None] Transfer volume completed successfully.
Nov 07 02:48:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Acquiring lock "cinder-d0cdb509-2ba4-4652-953d-6ee164eb0643-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Lock "cinder-d0cdb509-2ba4-4652-953d-6ee164eb0643-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Acquiring lock "cinder-quobyte-d0cdb509-2ba4-4652-953d-6ee164eb0643" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Lock "cinder-quobyte-d0cdb509-2ba4-4652-953d-6ee164eb0643" acquired by "delete_volume" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bd53f8-d0a9-4299-9234-952c69464ff9]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:48:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:10 devstack sudo[104936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643
Nov 07 02:48:10 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:10 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643" returned: 0 in 0.362s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:10 devstack sudo[104941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643
Nov 07 02:48:10 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:11 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d0cdb509-2ba4-4652-953d-6ee164eb0643" returned: 0 in 0.245s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Lock "cinder-quobyte-d0cdb509-2ba4-4652-953d-6ee164eb0643" released by "delete_volume" :: held 0.648s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Created reservations ['92f8729a-a7cd-4d42-9e85-60f1aafc8849', '58737ce8-3393-4c41-afbd-1d91ddc9fa8c', '48c6b444-946d-42d1-8bb2-f278ad34ac24', '0b318d1e-e64e-4e56-ab72-be51d3aacc70'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:11 devstack sudo[104944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:48:11 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:11 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.236s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:48:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Deleted volume successfully.
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a45cd900-094c-4f2f-a14b-2ffbbad5eabe tempest-VolumesTransfersV355Test-989668617 None] Lock "cinder-d0cdb509-2ba4-4652-953d-6ee164eb0643-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Flow 'volume_create_manager' (a3b2af02-7a72-4122-bb1d-78a19ff4eb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3055d41-f036-4d3b-b45a-a2a32d8e2e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3055d41-f036-4d3b-b45a-a2a32d8e2e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-147083641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec69f96-121f-45ae-9907-8da43962c087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91143a06d87446668bd631522d83e5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:12Z,use_quota=True,user_id='e424f29b0060482ab726b4dd4a0eec1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621c6504-53ef-4e00-a9b6-150b07085861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621c6504-53ef-4e00-a9b6-150b07085861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59979b32-c592-4668-ae80-2cbe948480df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59979b32-c592-4668-ae80-2cbe948480df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dec69f96-121f-45ae-9907-8da43962c087', 'volume_name': 'volume-dec69f96-121f-45ae-9907-8da43962c087', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ec383b-a200-4103-a54d-5bcb37d7c299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ec383b-a200-4103-a54d-5bcb37d7c299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4073497f-ea80-43bb-8896-e8ab55817761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Volume dec69f96-121f-45ae-9907-8da43962c087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dec69f96-121f-45ae-9907-8da43962c087', 'volume_size': 1}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-147083641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec69f96-121f-45ae-9907-8da43962c087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91143a06d87446668bd631522d83e5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:12Z,use_quota=True,user_id='e424f29b0060482ab726b4dd4a0eec1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Creating volume dec69f96-121f-45ae-9907-8da43962c087 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:48:12 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:12 devstack sudo[104947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087 1073741824
Nov 07 02:48:12 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:12 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087 1073741824" returned: 0 in 0.399s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:12 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087
Nov 07 02:48:12 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:12 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087" returned: 0 in 0.235s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4073497f-ea80-43bb-8896-e8ab55817761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dec69f96-121f-45ae-9907-8da43962c087', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a633375c-cbcb-41f7-8a48-48f07004b9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Volume volume-dec69f96-121f-45ae-9907-8da43962c087 (dec69f96-121f-45ae-9907-8da43962c087): created successfully
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a633375c-cbcb-41f7-8a48-48f07004b9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Flow 'volume_create_manager' (a3b2af02-7a72-4122-bb1d-78a19ff4eb77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cb2fa566-9fc2-40b6-9fa7-5989320a8b76 tempest-VolumesTransfersV355Test-1236583286 None] Created volume successfully.
Nov 07 02:48:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Acquiring lock "cinder-dec69f96-121f-45ae-9907-8da43962c087-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Lock "cinder-dec69f96-121f-45ae-9907-8da43962c087-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Acquiring lock "cinder-quobyte-dec69f96-121f-45ae-9907-8da43962c087" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Lock "cinder-quobyte-dec69f96-121f-45ae-9907-8da43962c087" acquired by "delete_volume" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab4d71-c8f2-4066-a4da-9b5e8f63d199]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:48:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:13 devstack sudo[104955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087
Nov 07 02:48:13 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:13 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087" returned: 0 in 0.354s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:13 devstack sudo[104960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087
Nov 07 02:48:13 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:13 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-dec69f96-121f-45ae-9907-8da43962c087" returned: 0 in 0.249s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Lock "cinder-quobyte-dec69f96-121f-45ae-9907-8da43962c087" released by "delete_volume" :: held 0.640s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:13 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Created reservations ['71762de4-ed72-4ac8-9582-1744b57dea5f', '288111b0-55ef-4f54-884c-a4b14c132d03', '9faa81af-2697-4d13-aa63-3560a0c7cfb6', 'dc21ddff-3053-4c6b-bd54-8be182ade2bb'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:48:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:14 devstack sudo[104963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:48:14 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:14 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:14 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:48:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Deleted volume successfully.
Nov 07 02:48:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7ef69bc6-73ca-4dc1-ac63-9ec5bb054a63 tempest-VolumesTransfersV355Test-989668617 None] Lock "cinder-dec69f96-121f-45ae-9907-8da43962c087-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Flow 'volume_create_manager' (b5640306-7246-488d-af11-6316f38ffc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de83452-7879-4cf3-bc18-d7cbb08c6b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de83452-7879-4cf3-bc18-d7cbb08c6b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1040494859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d7fa54-71fd-47e9-839a-8a9bb18f7adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a166b482d5db4a559001f464950edda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:21Z,use_quota=True,user_id='78b5f7578bac47dbaf01958e70868a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceaa0c35-853c-401e-8338-412341a3d55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceaa0c35-853c-401e-8338-412341a3d55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827803d8-3616-4547-9b63-64db8cfbf2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827803d8-3616-4547-9b63-64db8cfbf2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d7fa54-71fd-47e9-839a-8a9bb18f7adb', 'volume_name': 'volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded38feb-6acd-403b-ad30-f5098398613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded38feb-6acd-403b-ad30-f5098398613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed05adb-6be2-4f72-8526-7f11fd103cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Volume 13d7fa54-71fd-47e9-839a-8a9bb18f7adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb', 'volume_size': 1}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1040494859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d7fa54-71fd-47e9-839a-8a9bb18f7adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a166b482d5db4a559001f464950edda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:21Z,use_quota=True,user_id='78b5f7578bac47dbaf01958e70868a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Creating volume 13d7fa54-71fd-47e9-839a-8a9bb18f7adb {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:48:21 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:21 devstack sudo[104967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb 1073741824
Nov 07 02:48:21 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:21 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb 1073741824" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:21 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb
Nov 07 02:48:21 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:22 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb" returned: 0 in 0.236s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:48:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed05adb-6be2-4f72-8526-7f11fd103cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3bacaf0-870f-473d-9377-d4510a801ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Volume volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb (13d7fa54-71fd-47e9-839a-8a9bb18f7adb): created successfully
Nov 07 02:48:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3bacaf0-870f-473d-9377-d4510a801ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Flow 'volume_create_manager' (b5640306-7246-488d-af11-6316f38ffc4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5f502999-c70a-448e-b483-ed4b1b99b597 tempest-VolumesTransfersV357Test-1954817062 None] Created volume successfully.
Nov 07 02:48:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b064f54e-1304-4846-8304-c466dd960b15 tempest-VolumesTransfersV357Test-1101741414 None] Transfer volume completed successfully.
Nov 07 02:48:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Acquiring lock "cinder-13d7fa54-71fd-47e9-839a-8a9bb18f7adb-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Lock "cinder-13d7fa54-71fd-47e9-839a-8a9bb18f7adb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Acquiring lock "cinder-quobyte-13d7fa54-71fd-47e9-839a-8a9bb18f7adb" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Lock "cinder-quobyte-13d7fa54-71fd-47e9-839a-8a9bb18f7adb" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[88000f58-6e1a-47e2-b16b-628f1591ce3f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:48:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:23 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb
Nov 07 02:48:23 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:23 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:23 devstack sudo[104981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb
Nov 07 02:48:23 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:24 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-13d7fa54-71fd-47e9-839a-8a9bb18f7adb" returned: 0 in 0.244s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Lock "cinder-quobyte-13d7fa54-71fd-47e9-839a-8a9bb18f7adb" released by "delete_volume" :: held 0.633s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Created reservations ['16a082d9-4337-4c38-8797-759425507f69', '23f7c8f1-97b6-4fbe-acb5-39b1a11a45d6', '4ba97168-783a-45c2-8dbc-3007d9d0d03c', 'dcbf1b74-bd3c-4651-8090-17dedb1265ee'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:24 devstack sudo[104984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:48:24 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:24 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:48:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Deleted volume successfully.
Nov 07 02:48:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-529d23aa-7ec0-445e-9d58-5163446c2c77 tempest-VolumesTransfersV357Test-2008592080 None] Lock "cinder-13d7fa54-71fd-47e9-839a-8a9bb18f7adb-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Flow 'volume_create_manager' (d1ef42b3-f1c5-48bb-bc2f-5d1d8d501bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8417404c-7698-4459-8ccb-a0618ff69db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8417404c-7698-4459-8ccb-a0618ff69db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-446388915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a784fe-e34e-4f65-937f-2c07361560d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a166b482d5db4a559001f464950edda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:25Z,use_quota=True,user_id='78b5f7578bac47dbaf01958e70868a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc44e42-7125-401c-ab14-4cb04e71deec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc44e42-7125-401c-ab14-4cb04e71deec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff903595-351f-439f-a9b0-1190ab362539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff903595-351f-439f-a9b0-1190ab362539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a784fe-e34e-4f65-937f-2c07361560d1', 'volume_name': 'volume-f9a784fe-e34e-4f65-937f-2c07361560d1', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a143a54e-5dcc-44ea-bba7-d400c153f725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a143a54e-5dcc-44ea-bba7-d400c153f725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1d4725-6cce-4cdb-ad0d-17a13a41c675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Volume f9a784fe-e34e-4f65-937f-2c07361560d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a784fe-e34e-4f65-937f-2c07361560d1', 'volume_size': 1}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-446388915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a784fe-e34e-4f65-937f-2c07361560d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a166b482d5db4a559001f464950edda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:25Z,use_quota=True,user_id='78b5f7578bac47dbaf01958e70868a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Creating volume f9a784fe-e34e-4f65-937f-2c07361560d1 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:48:25 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:25 devstack sudo[104987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1 1073741824
Nov 07 02:48:25 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:25 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1 1073741824" returned: 0 in 0.396s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:25 devstack sudo[104992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1
Nov 07 02:48:25 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:25 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1" returned: 0 in 0.242s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1d4725-6cce-4cdb-ad0d-17a13a41c675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a784fe-e34e-4f65-937f-2c07361560d1', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf92bcc-3a0d-4e25-98d3-b03a83f0f226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Volume volume-f9a784fe-e34e-4f65-937f-2c07361560d1 (f9a784fe-e34e-4f65-937f-2c07361560d1): created successfully
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf92bcc-3a0d-4e25-98d3-b03a83f0f226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Flow 'volume_create_manager' (d1ef42b3-f1c5-48bb-bc2f-5d1d8d501bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f2997997-957e-4e6e-9130-2ff8727cad68 tempest-VolumesTransfersV357Test-1954817062 None] Created volume successfully.
Nov 07 02:48:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Acquiring lock "cinder-f9a784fe-e34e-4f65-937f-2c07361560d1-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Lock "cinder-f9a784fe-e34e-4f65-937f-2c07361560d1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Acquiring lock "cinder-quobyte-f9a784fe-e34e-4f65-937f-2c07361560d1" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Lock "cinder-quobyte-f9a784fe-e34e-4f65-937f-2c07361560d1" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:26 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf810db-31e4-4c3c-855c-d8a6c21355b3]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:48:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:26 devstack sudo[104996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1
Nov 07 02:48:26 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:26 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1" returned: 0 in 0.360s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:26 devstack sudo[105002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1
Nov 07 02:48:26 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:27 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f9a784fe-e34e-4f65-937f-2c07361560d1" returned: 0 in 0.263s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Lock "cinder-quobyte-f9a784fe-e34e-4f65-937f-2c07361560d1" released by "delete_volume" :: held 0.666s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Created reservations ['06669fa4-8a23-47de-9057-c640b56becf3', '33f7e165-7924-4d43-986d-f862cd642b0d', 'e63b93b5-3255-4ec4-8cad-ede0c213fd71', '99ce3639-8e07-4232-96d2-272b6f5a8182'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:27 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:48:27 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:27 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.246s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:48:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Deleted volume successfully.
Nov 07 02:48:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a12962d3-7772-4c4e-b56d-01beda1f5a56 tempest-VolumesTransfersV357Test-2008592080 None] Lock "cinder-f9a784fe-e34e-4f65-937f-2c07361560d1-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Flow 'volume_create_manager' (14ac193b-fdbc-4644-85fa-de930081f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27869bf7-5d16-425a-ad81-1d756c662403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27869bf7-5d16-425a-ad81-1d756c662403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-368404796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7125650d-06fe-4389-9cc0-f44a140b263a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e848191f97ab482c9d6f0aae97867ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:33Z,use_quota=True,user_id='1c3a0be6f1234ef1b68531a7576d1ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4a7fba-c292-4bc8-97d0-7a5e45d890a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4a7fba-c292-4bc8-97d0-7a5e45d890a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07de4b1e-623e-4388-a84f-cbb7cf670599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07de4b1e-623e-4388-a84f-cbb7cf670599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7125650d-06fe-4389-9cc0-f44a140b263a', 'volume_name': 'volume-7125650d-06fe-4389-9cc0-f44a140b263a', 'volume_size': 2}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfa256a-80c7-48b9-859f-8d834473449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfa256a-80c7-48b9-859f-8d834473449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8fd8826-98b9-488d-aa9e-ff4b22090988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:33 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Volume 7125650d-06fe-4389-9cc0-f44a140b263a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7125650d-06fe-4389-9cc0-f44a140b263a', 'volume_size': 2}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-368404796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7125650d-06fe-4389-9cc0-f44a140b263a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e848191f97ab482c9d6f0aae97867ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:33Z,use_quota=True,user_id='1c3a0be6f1234ef1b68531a7576d1ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Creating volume 7125650d-06fe-4389-9cc0-f44a140b263a {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:48:33 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a 2147483648 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:33 devstack sudo[105012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a 2147483648
Nov 07 02:48:33 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:33 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a 2147483648" returned: 0 in 0.454s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:33 devstack sudo[105018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a
Nov 07 02:48:33 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:33 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a" returned: 0 in 0.246s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8fd8826-98b9-488d-aa9e-ff4b22090988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7125650d-06fe-4389-9cc0-f44a140b263a', 'volume_size': 2}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2068df-77df-4ae9-a971-3f9285a4c6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:33 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Volume volume-7125650d-06fe-4389-9cc0-f44a140b263a (7125650d-06fe-4389-9cc0-f44a140b263a): created successfully
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2068df-77df-4ae9-a971-3f9285a4c6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Flow 'volume_create_manager' (14ac193b-fdbc-4644-85fa-de930081f44d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6a4cbc08-af90-451d-9af9-3ead32bfcf5c tempest-VolumesCloneNegativeTest-1198265382 None] Created volume successfully.
Nov 07 02:48:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Acquiring lock "cinder-7125650d-06fe-4389-9cc0-f44a140b263a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Lock "cinder-7125650d-06fe-4389-9cc0-f44a140b263a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Acquiring lock "cinder-quobyte-7125650d-06fe-4389-9cc0-f44a140b263a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Lock "cinder-quobyte-7125650d-06fe-4389-9cc0-f44a140b263a" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:34 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53cc38f-fa1b-4fc0-932c-7304900d40d5]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:48:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:34 devstack sudo[105021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a
Nov 07 02:48:34 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:34 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a" returned: 0 in 0.364s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:34 devstack sudo[105026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a
Nov 07 02:48:34 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:34 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7125650d-06fe-4389-9cc0-f44a140b263a" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Lock "cinder-quobyte-7125650d-06fe-4389-9cc0-f44a140b263a" released by "delete_volume" :: held 0.657s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:35 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Created reservations ['40946526-1dc6-4782-ae61-795d3dab0a37', 'd6b17093-9ee1-4a31-9285-15ff75fc72da', '4907ce15-6b1c-4cf5-88bb-d8659796d303', '3aa6c291-6e67-48cc-89ca-27d46d4d7e13'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:48:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:35 devstack sudo[105029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:48:35 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:35 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.251s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:35 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:48:35 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Deleted volume successfully.
Nov 07 02:48:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f36b360-c6af-410b-9fb1-70618d14fd98 tempest-VolumesCloneNegativeTest-1198265382 None] Lock "cinder-7125650d-06fe-4389-9cc0-f44a140b263a-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:45 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=41,cinder:UPDATE=59,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=52,cinder:SELECT=32,cinder:DELETE=6,cinder:INSERT=13 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Flow 'volume_create_manager' (0f99e78e-7e48-4ccc-b252-87b4ce6490bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99eafc3-7586-4685-abac-394a9a32f874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99eafc3-7586-4685-abac-394a9a32f874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-454225592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a48472dfeb4cb4b03db100bfa60c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:47Z,use_quota=True,user_id='5024824e2cb448cbb3edd6f1e6368e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4982e16-8a0d-4d04-8024-6613f511e201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4982e16-8a0d-4d04-8024-6613f511e201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4705b0a7-487d-4d4c-b6a0-6992df8dd442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4705b0a7-487d-4d4c-b6a0-6992df8dd442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd', 'volume_name': 'volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096e26bc-f29f-440e-8770-79b411979c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096e26bc-f29f-440e-8770-79b411979c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef05c2e5-8d53-430e-b671-0caaab20155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:46 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Volume 7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd', 'volume_size': 1}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-454225592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a48472dfeb4cb4b03db100bfa60c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:47Z,use_quota=True,user_id='5024824e2cb448cbb3edd6f1e6368e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Creating volume 7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:48:46 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:48:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:46 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd 1073741824
Nov 07 02:48:46 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:47 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd 1073741824" returned: 0 in 0.421s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:47 devstack sudo[105081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd
Nov 07 02:48:47 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:47 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd" returned: 0 in 0.242s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:48:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef05c2e5-8d53-430e-b671-0caaab20155c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34974b0-0667-4820-9c0f-070d6116254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:47 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Volume volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd (7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd): created successfully
Nov 07 02:48:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34974b0-0667-4820-9c0f-070d6116254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:47 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Flow 'volume_create_manager' (0f99e78e-7e48-4ccc-b252-87b4ce6490bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-04bd9e31-51a7-4aa7-88ff-04d917e46b03 tempest-VolumesSnapshotTestJSON-977988498 None] Created volume successfully.
Nov 07 02:48:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] Creating offline snapshot d4c81b82-22ea-4385-9db3-92a5f41d228e of volume 7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:48:48 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4817ec3-0dcb-487d-a178-8d34e1aae0bf]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:48:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:48 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd
Nov 07 02:48:48 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:48 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:48 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e 1G
Nov 07 02:48:48 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:48 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e 1G" returned: 0 in 0.382s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:48 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e
Nov 07 02:48:48 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:49 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e" returned: 0 in 0.292s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:49 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e is being set with open permissions: ugo+rw
Nov 07 02:48:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:49 devstack sudo[105100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e
Nov 07 02:48:49 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:49 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e" returned: 0 in 0.240s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:49 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.info
Nov 07 02:48:49 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:49 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.info" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:49 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.info is being set with open permissions: ugo+rw
Nov 07 02:48:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:49 devstack sudo[105106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.info
Nov 07 02:48:49 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:49 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.info" returned: 0 in 0.249s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cca7c350-2c14-437f-a1c8-ad1cb02fdeac tempest-VolumesSnapshotTestJSON-977988498 None] Create snapshot completed successfully
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-d4c81b82-22ea-4385-9db3-92a5f41d228e-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-d4c81b82-22ea-4385-9db3-92a5f41d228e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-d4c81b82-22ea-4385-9db3-92a5f41d228e" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-d4c81b82-22ea-4385-9db3-92a5f41d228e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Deleting offline snapshot d4c81b82-22ea-4385-9db3-92a5f41d228e of volume 7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] snapshot_file for this snap is: volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc04fd92-0ab7-49f7-9b36-9fa88c9278cc]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:50 devstack sudo[105109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e
Nov 07 02:48:50 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:50 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e" returned: 0 in 0.367s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47d426b-270a-471b-985a-e471fe254fa6]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:48:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:50 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd
Nov 07 02:48:50 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:51 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd" returned: 0 in 0.346s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:51 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e
Nov 07 02:48:51 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:51 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:51 devstack sudo[105124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e
Nov 07 02:48:51 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:51 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd.d4c81b82-22ea-4385-9db3-92a5f41d228e" returned: 0 in 0.235s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-d4c81b82-22ea-4385-9db3-92a5f41d228e" released by "_delete_snapshot" :: held 1.376s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd" released by "delete_snapshot" :: held 1.397s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:51 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Created reservations ['18b0e3f0-9ce5-4f25-9acf-2d46749af176', '39e91dd2-c444-45de-9956-87b528e75a8d', '01eb2057-53e1-4ba6-8153-fd45c84b22e3', '6ebfb992-04d4-430c-9b1e-7672501c2727'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:48:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Delete snapshot completed successfully.
Nov 07 02:48:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0d2efba7-b508-4985-8883-89f8e981ab5b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-d4c81b82-22ea-4385-9db3-92a5f41d228e-delete_snapshot" released by "delete_snapshot" :: held 1.554s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Flow 'volume_create_manager' (aa9d39e2-6c9c-4014-8002-bb1ca4bb31fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ff47d8-f2f6-415e-b3a9-28a35d45158e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ff47d8-f2f6-415e-b3a9-28a35d45158e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1691722652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8140c452-9c0c-4eef-974e-c409f8dca3fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a48472dfeb4cb4b03db100bfa60c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:53Z,use_quota=True,user_id='5024824e2cb448cbb3edd6f1e6368e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583062b0-5909-48e4-a782-2d3f2532d227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583062b0-5909-48e4-a782-2d3f2532d227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f1c71e-fef1-439b-937e-fb8ce2185a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f1c71e-fef1-439b-937e-fb8ce2185a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8140c452-9c0c-4eef-974e-c409f8dca3fc', 'volume_name': 'volume-8140c452-9c0c-4eef-974e-c409f8dca3fc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103aa118-3375-41ac-9038-c1251db33f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103aa118-3375-41ac-9038-c1251db33f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3bcc4f-919a-4ecc-ade7-6310af84e081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:52 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Volume 8140c452-9c0c-4eef-974e-c409f8dca3fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8140c452-9c0c-4eef-974e-c409f8dca3fc', 'volume_size': 1}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1691722652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8140c452-9c0c-4eef-974e-c409f8dca3fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a48472dfeb4cb4b03db100bfa60c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:53Z,use_quota=True,user_id='5024824e2cb448cbb3edd6f1e6368e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Creating volume 8140c452-9c0c-4eef-974e-c409f8dca3fc {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:48:52 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:48:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:53 devstack sudo[105127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc 1073741824
Nov 07 02:48:53 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:53 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc 1073741824" returned: 0 in 0.415s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:53 devstack sudo[105132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:48:53 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:53 devstack sudo[105134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc
Nov 07 02:48:53 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:53 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.241s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:48:53 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc" returned: 0 in 0.245s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3bcc4f-919a-4ecc-ade7-6310af84e081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8140c452-9c0c-4eef-974e-c409f8dca3fc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6169e1e0-0bcc-4e96-862f-c4f7d37844eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Volume volume-8140c452-9c0c-4eef-974e-c409f8dca3fc (8140c452-9c0c-4eef-974e-c409f8dca3fc): created successfully
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6169e1e0-0bcc-4e96-862f-c4f7d37844eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Flow 'volume_create_manager' (aa9d39e2-6c9c-4014-8002-bb1ca4bb31fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:53 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-504b15d5-b271-4979-a500-8f78314efaa8 tempest-VolumesSnapshotTestJSON-977988498 None] Created volume successfully.
Nov 07 02:48:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] Creating offline snapshot c0220e6d-f40a-4f14-918b-cbbbc9d572b6 of volume 8140c452-9c0c-4eef-974e-c409f8dca3fc {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:48:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99c75c1-af52-4c79-a8a5-7030f7019fae]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:48:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:54 devstack sudo[105138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc
Nov 07 02:48:54 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:54 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc" returned: 0 in 0.344s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:54 devstack sudo[105143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6 1G
Nov 07 02:48:54 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:54 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6 1G" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8140c452-9c0c-4eef-974e-c409f8dca3fc -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:54 devstack sudo[105149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8140c452-9c0c-4eef-974e-c409f8dca3fc -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6
Nov 07 02:48:54 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:55 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8140c452-9c0c-4eef-974e-c409f8dca3fc -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6" returned: 0 in 0.279s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:55 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6 is being set with open permissions: ugo+rw
Nov 07 02:48:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:55 devstack sudo[105154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6
Nov 07 02:48:55 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:55 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6" returned: 0 in 0.234s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:55 devstack sudo[105157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.info
Nov 07 02:48:55 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:55 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.info" returned: 0 in 0.253s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:55 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.info is being set with open permissions: ugo+rw
Nov 07 02:48:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:55 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.info
Nov 07 02:48:55 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:55 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.info" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-76fd6da5-2e04-4cac-8143-b9c00bf28b02 tempest-VolumesSnapshotTestJSON-977988498 None] Create snapshot completed successfully
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Flow 'volume_create_manager' (5b0e51ed-59e4-42e4-b4ca-c5eb75161459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d777caa0-3b97-426f-b8df-e4e3b393e809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d777caa0-3b97-426f-b8df-e4e3b393e809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-269013676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3cd61d2-99c1-4138-9f4d-da12e6be8161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a48472dfeb4cb4b03db100bfa60c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c0220e6d-f40a-4f14-918b-cbbbc9d572b6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:57Z,use_quota=True,user_id='5024824e2cb448cbb3edd6f1e6368e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a59119-1bba-4779-88d0-32da7c712d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a59119-1bba-4779-88d0-32da7c712d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ecd1ef-2b6a-46fc-916a-26ebce0b4bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ecd1ef-2b6a-46fc-916a-26ebce0b4bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c3cd61d2-99c1-4138-9f4d-da12e6be8161', 'volume_name': 'volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161', 'volume_size': 2, 'snapshot_id': 'c0220e6d-f40a-4f14-918b-cbbbc9d572b6'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276b2bde-acbc-4988-bead-a77aeec4fb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276b2bde-acbc-4988-bead-a77aeec4fb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d32b31-8cd3-4237-a468-8d8fcf78cb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Volume c3cd61d2-99c1-4138-9f4d-da12e6be8161: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161', 'volume_size': 2, 'snapshot_id': 'c0220e6d-f40a-4f14-918b-cbbbc9d572b6'}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-c0220e6d-f40a-4f14-918b-cbbbc9d572b6-c3cd61d2-99c1-4138-9f4d-da12e6be8161" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-c0220e6d-f40a-4f14-918b-cbbbc9d572b6-c3cd61d2-99c1-4138-9f4d-da12e6be8161" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Creating volume c3cd61d2-99c1-4138-9f4d-da12e6be8161 from snapshot c0220e6d-f40a-4f14-918b-cbbbc9d572b6 {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-c3cd61d2-99c1-4138-9f4d-da12e6be8161" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-c3cd61d2-99c1-4138-9f4d-da12e6be8161" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] snapshot: c0220e6d-f40a-4f14-918b-cbbbc9d572b6, volume: c3cd61d2-99c1-4138-9f4d-da12e6be8161,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e22d1d-f318-4eb1-8e39-be45b5a982f3]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:48:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:56 devstack sudo[105163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6
Nov 07 02:48:56 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:57 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8140c452-9c0c-4eef-974e-c409f8dca3fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:48:57 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5391d67b-651f-496e-8853-481700e99b78]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:48:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:57 devstack sudo[105168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc
Nov 07 02:48:57 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:57 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:48:57 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:48:57 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161 not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:48:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:57 devstack sudo[105174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161
Nov 07 02:48:57 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:03 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161" returned: 0 in 5.923s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:03 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:49:03 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Converted 1024.00 MB image at 172.83 MB/s
Nov 07 02:49:03 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161 is being set with open permissions: ugo+rw
Nov 07 02:49:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:03 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161
Nov 07 02:49:03 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:03 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161" returned: 0 in 0.235s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-c3cd61d2-99c1-4138-9f4d-da12e6be8161" released by "_copy_volume_from_snapshot" :: held 6.939s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-c0220e6d-f40a-4f14-918b-cbbbc9d572b6-c3cd61d2-99c1-4138-9f4d-da12e6be8161" released by "_create_volume_from_snapshot" :: held 6.996s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d32b31-8cd3-4237-a468-8d8fcf78cb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161', 'volume_size': 2, 'snapshot_id': 'c0220e6d-f40a-4f14-918b-cbbbc9d572b6'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc24f1f-b93e-49bf-81f2-e6103260fd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:03 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Volume volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161 (c3cd61d2-99c1-4138-9f4d-da12e6be8161): created successfully
Nov 07 02:49:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc24f1f-b93e-49bf-81f2-e6103260fd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Flow 'volume_create_manager' (5b0e51ed-59e4-42e4-b4ca-c5eb75161459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-efa1ca4d-135f-496e-a8c7-f9fb837e9eb2 tempest-VolumesSnapshotTestJSON-977988498 None] Created volume successfully.
Nov 07 02:49:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-c3cd61d2-99c1-4138-9f4d-da12e6be8161-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-c3cd61d2-99c1-4138-9f4d-da12e6be8161-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-c3cd61d2-99c1-4138-9f4d-da12e6be8161" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-c3cd61d2-99c1-4138-9f4d-da12e6be8161" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bfedec-81c4-41ee-a823-2822a92804a3]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:04 devstack sudo[105191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161
Nov 07 02:49:04 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:04 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:04 devstack sudo[105196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161
Nov 07 02:49:04 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:04 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-c3cd61d2-99c1-4138-9f4d-da12e6be8161" returned: 0 in 0.241s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-c3cd61d2-99c1-4138-9f4d-da12e6be8161" released by "delete_volume" :: held 0.634s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Created reservations ['044dc77a-9d80-4d5d-bdf8-a7c0be625036', '33a41a58-d1ae-4a00-b11e-eb2261f3da97', 'dc43861b-566c-4a40-b02d-d7ae993b4502', '0f1badd5-32df-43dd-bfcc-7f39a82136a2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:05 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:49:05 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:05 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.237s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:49:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Deleted volume successfully.
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e96563a7-d31e-40c5-8128-4bbc6be332f5 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-c3cd61d2-99c1-4138-9f4d-da12e6be8161-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-c0220e6d-f40a-4f14-918b-cbbbc9d572b6-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-c0220e6d-f40a-4f14-918b-cbbbc9d572b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-8140c452-9c0c-4eef-974e-c409f8dca3fc" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-8140c452-9c0c-4eef-974e-c409f8dca3fc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-c0220e6d-f40a-4f14-918b-cbbbc9d572b6" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-c0220e6d-f40a-4f14-918b-cbbbc9d572b6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Deleting offline snapshot c0220e6d-f40a-4f14-918b-cbbbc9d572b6 of volume 8140c452-9c0c-4eef-974e-c409f8dca3fc {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] snapshot_file for this snap is: volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dd9e30-754c-46ca-b870-0671a4933452]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:05 devstack sudo[105202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6
Nov 07 02:49:05 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:05 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8140c452-9c0c-4eef-974e-c409f8dca3fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c9f7a7-4d1b-4656-bad9-0d3fbbd06b73]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:06 devstack sudo[105207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc
Nov 07 02:49:06 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:06 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc" returned: 0 in 0.532s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:06 devstack sudo[105212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6
Nov 07 02:49:06 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:06 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6" returned: 0 in 0.327s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:06 devstack sudo[105217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6
Nov 07 02:49:06 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:07 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc.c0220e6d-f40a-4f14-918b-cbbbc9d572b6" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-c0220e6d-f40a-4f14-918b-cbbbc9d572b6" released by "_delete_snapshot" :: held 1.557s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-8140c452-9c0c-4eef-974e-c409f8dca3fc" released by "delete_snapshot" :: held 1.579s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:07 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Created reservations ['168cc2ad-73be-4ce6-852e-f33359b1b8c4', '21cf0135-81a1-4f8f-b57d-3a8edc958e98', 'f67ecff4-655e-4c8a-90a2-a51835ac6fec', 'ab397f45-202d-4ebe-8023-47d7eb713a59'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:49:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Delete snapshot completed successfully.
Nov 07 02:49:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1fbe4dcc-260f-4d7f-923d-b9648dcc3472 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-c0220e6d-f40a-4f14-918b-cbbbc9d572b6-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-8140c452-9c0c-4eef-974e-c409f8dca3fc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-8140c452-9c0c-4eef-974e-c409f8dca3fc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-8140c452-9c0c-4eef-974e-c409f8dca3fc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-8140c452-9c0c-4eef-974e-c409f8dca3fc" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[740684ec-c086-4c1c-9f22-efa98794b23b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:07 devstack sudo[105220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc
Nov 07 02:49:07 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:08 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc" returned: 0 in 0.356s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:08 devstack sudo[105226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc
Nov 07 02:49:08 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:08 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8140c452-9c0c-4eef-974e-c409f8dca3fc" returned: 0 in 0.245s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-8140c452-9c0c-4eef-974e-c409f8dca3fc" released by "delete_volume" :: held 0.659s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Created reservations ['b33eaedc-25fe-4363-821b-c90fc3b68c27', '9bf67bea-10a9-4176-8258-025c4529d75e', '5573b7fb-d4df-408a-8e6b-bffd6e38c4df', '04380537-ea27-46db-95c3-a375a5edf5a3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:08 devstack sudo[105229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:49:08 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:08 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.242s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:49:08 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Deleted volume successfully.
Nov 07 02:49:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7793d76-601a-4982-87d7-d70a34e1da85 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-8140c452-9c0c-4eef-974e-c409f8dca3fc-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Flow 'volume_create_manager' (41183a6e-b2be-47bd-a0ed-caec4a18d1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cebdd2-70fb-49a5-a051-e5a1b2a18517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cebdd2-70fb-49a5-a051-e5a1b2a18517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-244118755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a7d14d-7df3-4743-b1ca-e730f4e80936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a48472dfeb4cb4b03db100bfa60c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:49:09Z,use_quota=True,user_id='5024824e2cb448cbb3edd6f1e6368e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd5ef90-5954-459e-95ee-f0f088e5b069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd5ef90-5954-459e-95ee-f0f088e5b069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff54847-264f-4b64-a219-6d77d9188026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff54847-264f-4b64-a219-6d77d9188026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a7d14d-7df3-4743-b1ca-e730f4e80936', 'volume_name': 'volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ab5c9e-bc98-46ec-b95b-4dd4c949541c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ab5c9e-bc98-46ec-b95b-4dd4c949541c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf1c0c1-dec5-43b4-a73e-92042cb77352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Volume d6a7d14d-7df3-4743-b1ca-e730f4e80936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936', 'volume_size': 1}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-244118755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a7d14d-7df3-4743-b1ca-e730f4e80936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a48472dfeb4cb4b03db100bfa60c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:49:09Z,use_quota=True,user_id='5024824e2cb448cbb3edd6f1e6368e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Creating volume d6a7d14d-7df3-4743-b1ca-e730f4e80936 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:49:09 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:09 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 1073741824
Nov 07 02:49:09 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:09 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 1073741824" returned: 0 in 0.413s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:09 devstack sudo[105237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936
Nov 07 02:49:09 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:10 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936" returned: 0 in 0.242s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf1c0c1-dec5-43b4-a73e-92042cb77352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97b31dd-bdaf-462f-9b1b-63eb4a6b3fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:10 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Volume volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 (d6a7d14d-7df3-4743-b1ca-e730f4e80936): created successfully
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97b31dd-bdaf-462f-9b1b-63eb4a6b3fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Flow 'volume_create_manager' (41183a6e-b2be-47bd-a0ed-caec4a18d1aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4fa76d60-cf78-48a2-a0cf-d2e4675e0566 tempest-VolumesSnapshotTestJSON-977988498 None] Created volume successfully.
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] Creating offline snapshot 419af369-a8a7-4ff5-b7ee-5bf8c476cc9e of volume d6a7d14d-7df3-4743-b1ca-e730f4e80936 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c56bf43-ea7f-49e4-8cf0-9ed8370f2436]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:10 devstack sudo[105240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936
Nov 07 02:49:10 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:10 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936" returned: 0 in 0.354s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:10 devstack sudo[105245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e 1G
Nov 07 02:49:10 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:11 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e 1G" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:11 devstack sudo[105251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e
Nov 07 02:49:11 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:11 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e" returned: 0 in 0.283s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:11 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e is being set with open permissions: ugo+rw
Nov 07 02:49:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:11 devstack sudo[105257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e
Nov 07 02:49:11 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:11 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e" returned: 0 in 0.231s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:11 devstack sudo[105260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.info
Nov 07 02:49:11 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:12 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.info" returned: 0 in 0.243s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:12 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.info is being set with open permissions: ugo+rw
Nov 07 02:49:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:12 devstack sudo[105263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.info
Nov 07 02:49:12 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:12 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.info" returned: 0 in 0.242s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-76bd2c18-ed64-478e-afe4-34f0ea8cb248 tempest-VolumesSnapshotTestJSON-977988498 None] Create snapshot completed successfully
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Flow 'volume_create_manager' (da68c1ad-2d1d-4ef5-b639-71296029f372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287a83b7-ad7e-47c3-b8a8-60bb312be347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287a83b7-ad7e-47c3-b8a8-60bb312be347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1231545661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5d7966-b013-4a26-ae68-dcf7dfce814a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a48472dfeb4cb4b03db100bfa60c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=419af369-a8a7-4ff5-b7ee-5bf8c476cc9e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:49:13Z,use_quota=True,user_id='5024824e2cb448cbb3edd6f1e6368e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e65941f-0e85-4c10-b292-ea514974f115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e65941f-0e85-4c10-b292-ea514974f115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7c9686-ce56-4821-b85c-b47d4a80f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7c9686-ce56-4821-b85c-b47d4a80f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5a5d7966-b013-4a26-ae68-dcf7dfce814a', 'volume_name': 'volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a', 'volume_size': 1, 'snapshot_id': '419af369-a8a7-4ff5-b7ee-5bf8c476cc9e'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af59ab86-4d2e-474b-b76e-97f4f638f2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af59ab86-4d2e-474b-b76e-97f4f638f2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0850da-2838-4d36-a233-32d97ccd1ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Volume 5a5d7966-b013-4a26-ae68-dcf7dfce814a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a', 'volume_size': 1, 'snapshot_id': '419af369-a8a7-4ff5-b7ee-5bf8c476cc9e'}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-419af369-a8a7-4ff5-b7ee-5bf8c476cc9e-5a5d7966-b013-4a26-ae68-dcf7dfce814a" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-419af369-a8a7-4ff5-b7ee-5bf8c476cc9e-5a5d7966-b013-4a26-ae68-dcf7dfce814a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Creating volume 5a5d7966-b013-4a26-ae68-dcf7dfce814a from snapshot 419af369-a8a7-4ff5-b7ee-5bf8c476cc9e {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-5a5d7966-b013-4a26-ae68-dcf7dfce814a" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-5a5d7966-b013-4a26-ae68-dcf7dfce814a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] snapshot: 419af369-a8a7-4ff5-b7ee-5bf8c476cc9e, volume: 5a5d7966-b013-4a26-ae68-dcf7dfce814a,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31ca398-57c0-42c1-a310-3536234562b7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:13 devstack sudo[105266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e
Nov 07 02:49:13 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:13 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e" returned: 0 in 0.350s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef34f90-0cd0-466c-8c73-2a7caee4d1fa]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:13 devstack sudo[105271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936
Nov 07 02:49:13 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:14 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:49:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:49:14 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:49:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:14 devstack sudo[105276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a
Nov 07 02:49:14 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:19 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a" returned: 0 in 5.873s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:19 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:49:19 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Converted 1024.00 MB image at 174.33 MB/s
Nov 07 02:49:19 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a is being set with open permissions: ugo+rw
Nov 07 02:49:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:19 devstack sudo[105290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a
Nov 07 02:49:19 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:20 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a" returned: 0 in 0.240s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-5a5d7966-b013-4a26-ae68-dcf7dfce814a" released by "_copy_volume_from_snapshot" :: held 6.902s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-419af369-a8a7-4ff5-b7ee-5bf8c476cc9e-5a5d7966-b013-4a26-ae68-dcf7dfce814a" released by "_create_volume_from_snapshot" :: held 6.959s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.975s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0850da-2838-4d36-a233-32d97ccd1ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a', 'volume_size': 1, 'snapshot_id': '419af369-a8a7-4ff5-b7ee-5bf8c476cc9e'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be04ed8b-244f-4de9-8c1d-5eaf4a9c867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Volume volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a (5a5d7966-b013-4a26-ae68-dcf7dfce814a): created successfully
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be04ed8b-244f-4de9-8c1d-5eaf4a9c867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Flow 'volume_create_manager' (da68c1ad-2d1d-4ef5-b639-71296029f372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-34f61ebf-cbfd-4966-9432-1e2ff478e03b tempest-VolumesSnapshotTestJSON-977988498 None] Created volume successfully.
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-5a5d7966-b013-4a26-ae68-dcf7dfce814a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-5a5d7966-b013-4a26-ae68-dcf7dfce814a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-5a5d7966-b013-4a26-ae68-dcf7dfce814a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-5a5d7966-b013-4a26-ae68-dcf7dfce814a" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[869fe8d8-cc6c-419d-b3d3-c4d351110f89]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:21 devstack sudo[105293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a
Nov 07 02:49:21 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:21 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a" returned: 0 in 0.347s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:21 devstack sudo[105298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a
Nov 07 02:49:21 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:21 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5a5d7966-b013-4a26-ae68-dcf7dfce814a" returned: 0 in 0.248s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-5a5d7966-b013-4a26-ae68-dcf7dfce814a" released by "delete_volume" :: held 0.635s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Created reservations ['aa1ec187-a6f7-4f41-b4cb-9ca3f0cc7a20', '6b00467f-e2e4-4956-9196-0a31dd187821', 'da1eff47-f0fd-4bbe-846b-d933ae9eba11', '51e13c1b-f7cc-4f12-8383-92eccb26a2f5'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:21 devstack sudo[105301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:49:21 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:21 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.240s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:49:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Deleted volume successfully.
Nov 07 02:49:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7488555d-c774-48a5-91aa-2a90e7c863cd tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-5a5d7966-b013-4a26-ae68-dcf7dfce814a-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-419af369-a8a7-4ff5-b7ee-5bf8c476cc9e-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-419af369-a8a7-4ff5-b7ee-5bf8c476cc9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-d6a7d14d-7df3-4743-b1ca-e730f4e80936" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-d6a7d14d-7df3-4743-b1ca-e730f4e80936" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-419af369-a8a7-4ff5-b7ee-5bf8c476cc9e" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-419af369-a8a7-4ff5-b7ee-5bf8c476cc9e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Deleting offline snapshot 419af369-a8a7-4ff5-b7ee-5bf8c476cc9e of volume d6a7d14d-7df3-4743-b1ca-e730f4e80936 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] snapshot_file for this snap is: volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5133685f-3a36-42b6-b4a7-f29c06f53362]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:22 devstack sudo[105304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e
Nov 07 02:49:22 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:22 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e" returned: 0 in 0.348s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b750f8e0-fa17-4404-a204-8fd2d5fc7187]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:22 devstack sudo[105309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936
Nov 07 02:49:22 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:23 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936" returned: 0 in 0.524s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:23 devstack sudo[105314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e
Nov 07 02:49:23 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:23 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:23 devstack sudo[105319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e
Nov 07 02:49:23 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:23 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936.419af369-a8a7-4ff5-b7ee-5bf8c476cc9e" returned: 0 in 0.236s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-419af369-a8a7-4ff5-b7ee-5bf8c476cc9e" released by "_delete_snapshot" :: held 1.531s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-d6a7d14d-7df3-4743-b1ca-e730f4e80936" released by "delete_snapshot" :: held 1.551s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:23 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Created reservations ['18cdddd3-a564-4300-80a5-d9174bb4c2d3', 'd3f56df5-6ca6-4c88-88d9-55dedbf161c3', '70259c2a-6c28-4b4b-aa80-ef500c73e2c5', 'ec3962d6-7934-4cf7-b8f6-905d44de8ac9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:49:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Delete snapshot completed successfully.
Nov 07 02:49:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8456c6cd-b9d3-4a88-995d-7724b2b0e014 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-419af369-a8a7-4ff5-b7ee-5bf8c476cc9e-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-d6a7d14d-7df3-4743-b1ca-e730f4e80936-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-d6a7d14d-7df3-4743-b1ca-e730f4e80936-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-d6a7d14d-7df3-4743-b1ca-e730f4e80936" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-d6a7d14d-7df3-4743-b1ca-e730f4e80936" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f61874-d5d1-456e-b8d8-0a1db4f232ad]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:24 devstack sudo[105322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936
Nov 07 02:49:24 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:24 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:24 devstack sudo[105327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936
Nov 07 02:49:24 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:24 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d6a7d14d-7df3-4743-b1ca-e730f4e80936" returned: 0 in 0.238s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-d6a7d14d-7df3-4743-b1ca-e730f4e80936" released by "delete_volume" :: held 0.648s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Created reservations ['7ef307bc-6635-4c86-8b1a-72e123b0eae7', 'e16d3291-5a36-40ab-a0ba-7912ec7be25d', 'ef8e9fbb-70e5-4dbb-88e9-939f938e1254', '5ec9d48c-99c8-4822-8283-35900c65dc87'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:25 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:49:25 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:25 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:49:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Deleted volume successfully.
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cde42c9a-4684-48aa-b7bc-c021723b6e29 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-d6a7d14d-7df3-4743-b1ca-e730f4e80936-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "cinder-quobyte-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5c7e92-ff49-494d-b484-34a1894df4e1]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:25 devstack sudo[105333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd
Nov 07 02:49:25 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:25 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd" returned: 0 in 0.355s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:25 devstack sudo[105339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd
Nov 07 02:49:25 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:26 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd" returned: 0 in 0.240s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-quobyte-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd" released by "delete_volume" :: held 0.654s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Created reservations ['08e39987-f6ed-40bf-8996-0ab14f2db831', '6d7250db-8756-4f7c-b1e9-316ac114ee85', '2ffd1f30-efa9-4bd4-84d5-adb04ea471e6', '80649f9b-6d14-49be-b56e-940fe5eac839'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:26 devstack sudo[105342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:49:26 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:26 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.238s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:49:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Deleted volume successfully.
Nov 07 02:49:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cc96860e-de39-47cf-afeb-25ed0d859375 tempest-VolumesSnapshotTestJSON-977988498 None] Lock "cinder-7bccb0a0-fe98-4607-9fb0-fe2d5bb680bd-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:36 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=73,cinder:INSERT=23,cinder:UPDATE=77,cinder:DELETE=5 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:49:36 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=76,cinder:SELECT=69,cinder:DELETE=8,cinder:INSERT=17 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:53 devstack sudo[105396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:49:53 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:53 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.257s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:49:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Flow 'volume_create_manager' (62e46e49-5c15-4000-ab21-24eb7ab9bbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54c025c-7784-4882-9f1d-764da0db2ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54c025c-7784-4882-9f1d-764da0db2ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1295978129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac43247a-b59d-4d9f-96c0-c3cf91df05b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828daf4887c443c974d648bb3ce5bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:49:55Z,use_quota=True,user_id='b9d4cb49c3464deb9eb3d69e9154c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2adea346-fb9b-45bc-bb87-46f2d6bd6b60),volume_type_id=2adea346-fb9b-45bc-bb87-46f2d6bd6b60)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96845ec-8525-4bd9-bed9-7682565db61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96845ec-8525-4bd9-bed9-7682565db61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88620ce-c16d-4979-ac4f-32317d19d6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88620ce-c16d-4979-ac4f-32317d19d6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac43247a-b59d-4d9f-96c0-c3cf91df05b7', 'volume_name': 'volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b22e0b-b067-452d-8586-78afeda57711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b22e0b-b067-452d-8586-78afeda57711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dbd1b5-c81d-432d-ab0c-8bafc7aed4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Volume ac43247a-b59d-4d9f-96c0-c3cf91df05b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7', 'volume_size': 1}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1295978129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac43247a-b59d-4d9f-96c0-c3cf91df05b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828daf4887c443c974d648bb3ce5bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:49:55Z,use_quota=True,user_id='b9d4cb49c3464deb9eb3d69e9154c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2adea346-fb9b-45bc-bb87-46f2d6bd6b60),volume_type_id=2adea346-fb9b-45bc-bb87-46f2d6bd6b60)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Creating volume ac43247a-b59d-4d9f-96c0-c3cf91df05b7 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:49:55 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:55 devstack sudo[105399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7 1073741824
Nov 07 02:49:55 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Flow 'volume_create_manager' (0e08b0bd-5416-498e-a774-cf470b6c24af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ac9ec8-e3d5-4c45-9830-f9ad6ad1e3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ac9ec8-e3d5-4c45-9830-f9ad6ad1e3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-817482775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828daf4887c443c974d648bb3ce5bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:49:55Z,use_quota=True,user_id='b9d4cb49c3464deb9eb3d69e9154c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(272f4db3-0a20-4e04-a063-6c0d882068b9),volume_type_id=272f4db3-0a20-4e04-a063-6c0d882068b9)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e429461-2635-4896-82b8-2d0563b36eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e429461-2635-4896-82b8-2d0563b36eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b68c3e-3615-4b82-8ed5-72b0f7bd02b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b68c3e-3615-4b82-8ed5-72b0f7bd02b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521', 'volume_name': 'volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e269c9-b044-416f-8b5e-47431b29be2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e269c9-b044-416f-8b5e-47431b29be2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493e755c-22b9-451f-9b7b-0790f1a61a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Volume e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521', 'volume_size': 1}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:55 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7 1073741824" returned: 0 in 0.497s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:55 devstack sudo[105405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7
Nov 07 02:49:55 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:55 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7" returned: 0 in 0.277s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-817482775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828daf4887c443c974d648bb3ce5bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:49:55Z,use_quota=True,user_id='b9d4cb49c3464deb9eb3d69e9154c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(272f4db3-0a20-4e04-a063-6c0d882068b9),volume_type_id=272f4db3-0a20-4e04-a063-6c0d882068b9)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Creating volume e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:49:55 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dbd1b5-c81d-432d-ab0c-8bafc7aed4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:55 devstack sudo[105408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521 1073741824
Nov 07 02:49:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48f470e-397a-447e-afc3-456200e9fbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:55 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Volume volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7 (ac43247a-b59d-4d9f-96c0-c3cf91df05b7): created successfully
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48f470e-397a-447e-afc3-456200e9fbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Flow 'volume_create_manager' (62e46e49-5c15-4000-ab21-24eb7ab9bbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:56 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-79390462-f38a-49b2-a8ef-dc1881283ee0 tempest-TestInstancesWithCinderVolumes-1741469939 None] Created volume successfully.
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Flow 'volume_create_manager' (6ddae214-9c59-46af-a5cf-f60908e53a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1303fb26-f89d-439d-b8f8-423f7341e1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1303fb26-f89d-439d-b8f8-423f7341e1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-947066753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d393dd-819e-419f-81ab-e048e33b075f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828daf4887c443c974d648bb3ce5bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:49:56Z,use_quota=True,user_id='b9d4cb49c3464deb9eb3d69e9154c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09715aee-7d93-4ef7-bc55-25175ce7880d),volume_type_id=09715aee-7d93-4ef7-bc55-25175ce7880d)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320764ff-1d39-40a6-b48e-c559fcacfef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320764ff-1d39-40a6-b48e-c559fcacfef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adf8558-b6bc-47c3-9871-53e4c6e1cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:49:56 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521 1073741824" returned: 0 in 0.422s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adf8558-b6bc-47c3-9871-53e4c6e1cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07d393dd-819e-419f-81ab-e048e33b075f', 'volume_name': 'volume-07d393dd-819e-419f-81ab-e048e33b075f', 'volume_size': 1, 'image_id': '1dd92405-67d3-4fee-95e4-68f9d1c63456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1dd92405-67d3-4fee-95e4-68f9d1c63456', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--673397634', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4828daf4887c443c974d648bb3ce5bca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1dd92405-67d3-4fee-95e4-68f9d1c63456', 'created_at': datetime.datetime(2026, 11, 7, 1, 49, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 49, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1dd92405-67d3-4fee-95e4-68f9d1c63456/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb373110>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53be970-b631-458c-9f35-c955306ba550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53be970-b631-458c-9f35-c955306ba550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49fc1ee-999c-4bef-93f2-d0a8aa114e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Volume 07d393dd-819e-419f-81ab-e048e33b075f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07d393dd-819e-419f-81ab-e048e33b075f', 'volume_size': 1, 'image_id': '1dd92405-67d3-4fee-95e4-68f9d1c63456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1dd92405-67d3-4fee-95e4-68f9d1c63456', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--673397634', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4828daf4887c443c974d648bb3ce5bca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1dd92405-67d3-4fee-95e4-68f9d1c63456', 'created_at': datetime.datetime(2026, 11, 7, 1, 49, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 49, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1dd92405-67d3-4fee-95e4-68f9d1c63456/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb373110>}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Trying to clone 07d393dd-819e-419f-81ab-e048e33b075f from image 1dd92405-67d3-4fee-95e4-68f9d1c63456 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1dd92405-67d3-4fee-95e4-68f9d1c63456', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:56 devstack sudo[105414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521
Nov 07 02:49:56 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:56 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521" returned: 0 in 0.252s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493e755c-22b9-451f-9b7b-0790f1a61a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427db3e2-4176-4104-b5b6-1a0f3686b7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Volume volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521 (e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521): created successfully
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427db3e2-4176-4104-b5b6-1a0f3686b7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Flow 'volume_create_manager' (0e08b0bd-5416-498e-a774-cf470b6c24af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:56 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7c424fd1-d799-447d-a1ec-e27e34e448b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Created volume successfully.
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD, size 20.69 MB, duration 2.79 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:49:59 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Image download 20.69 MB at 7.41 MB/s
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[418a1674-315e-47c1-82f9-a8273462dd44]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:59 devstack sudo[105419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD
Nov 07 02:49:59 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:59 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Temporary image 1dd92405-67d3-4fee-95e4-68f9d1c63456 is fetched for user b9d4cb49c3464deb9eb3d69e9154c54f. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed972607-7c78-48f1-b793-34670ff8bb55]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:59 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD
Nov 07 02:49:59 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:59 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-947066753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d393dd-819e-419f-81ab-e048e33b075f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828daf4887c443c974d648bb3ce5bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:49:56Z,use_quota=True,user_id='b9d4cb49c3464deb9eb3d69e9154c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09715aee-7d93-4ef7-bc55-25175ce7880d),volume_type_id=09715aee-7d93-4ef7-bc55-25175ce7880d)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Creating volume 07d393dd-819e-419f-81ab-e048e33b075f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:49:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:49:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:00 devstack sudo[105429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f 1073741824
Nov 07 02:50:00 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:00 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f 1073741824" returned: 0 in 0.411s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:00 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f
Nov 07 02:50:00 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:00 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f" returned: 0 in 0.240s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:50:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:00 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Attempting download of 1dd92405-67d3-4fee-95e4-68f9d1c63456 ((None, [{'url': 'file:///opt/stack/data/glance/images/1dd92405-67d3-4fee-95e4-68f9d1c63456', 'metadata': {}}])) to volume 07d393dd-819e-419f-81ab-e048e33b075f. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:50:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc456687-94e3-459b-a90b-1ef5ca5aedda]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1dd92405-67d3-4fee-95e4-68f9d1c63456_lhzsm94o {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:00 devstack sudo[105437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1dd92405-67d3-4fee-95e4-68f9d1c63456_lhzsm94o
Nov 07 02:50:00 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:01 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1dd92405-67d3-4fee-95e4-68f9d1c63456_lhzsm94o" returned: 0 in 0.316s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1dd92405-67d3-4fee-95e4-68f9d1c63456_lhzsm94o {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:01 devstack sudo[105441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1dd92405-67d3-4fee-95e4-68f9d1c63456_lhzsm94o
Nov 07 02:50:01 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:01 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1dd92405-67d3-4fee-95e4-68f9d1c63456_lhzsm94o" returned: 1 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1dd92405-67d3-4fee-95e4-68f9d1c63456_lhzsm94o' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:50:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07701c8-de78-4508-8913-da0e29d6f2cd]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:01 devstack sudo[105445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD
Nov 07 02:50:01 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:01 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:01 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] 1dd92405-67d3-4fee-95e4-68f9d1c63456 was qcow2, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:50:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:01 devstack sudo[105450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f
Nov 07 02:50:01 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:03 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f" returned: 0 in 1.698s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1dd92405-67d3-4fee-95e4-68f9d1c63456_l5omwebndevstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:50:03 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Converted 112.00 MB image at 65.90 MB/s
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:03 devstack sudo[105461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f 1G
Nov 07 02:50:03 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:03 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f 1G" returned: 0 in 0.316s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Downloaded image 1dd92405-67d3-4fee-95e4-68f9d1c63456 ((None, [{'url': 'file:///opt/stack/data/glance/images/1dd92405-67d3-4fee-95e4-68f9d1c63456', 'metadata': {}}])) to volume 07d393dd-819e-419f-81ab-e048e33b075f successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Temporary image 1dd92405-67d3-4fee-95e4-68f9d1c63456 for user b9d4cb49c3464deb9eb3d69e9154c54f is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Marking volume 07d393dd-819e-419f-81ab-e048e33b075f as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Copying metadata from image 1dd92405-67d3-4fee-95e4-68f9d1c63456 to 07d393dd-819e-419f-81ab-e048e33b075f. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Creating volume glance metadata for volume 07d393dd-819e-419f-81ab-e048e33b075f backed by image 1dd92405-67d3-4fee-95e4-68f9d1c63456 with: {'image_id': '1dd92405-67d3-4fee-95e4-68f9d1c63456', 'image_name': 'tempest-scenario-img--673397634', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49fc1ee-999c-4bef-93f2-d0a8aa114e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d393dd-819e-419f-81ab-e048e33b075f', 'volume_size': 1, 'image_id': '1dd92405-67d3-4fee-95e4-68f9d1c63456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1dd92405-67d3-4fee-95e4-68f9d1c63456', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--673397634', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4828daf4887c443c974d648bb3ce5bca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1dd92405-67d3-4fee-95e4-68f9d1c63456', 'created_at': datetime.datetime(2026, 11, 7, 1, 49, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 49, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1dd92405-67d3-4fee-95e4-68f9d1c63456/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb373110>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1109d71f-2202-4139-b809-2476a6f277b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:03 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Volume volume-07d393dd-819e-419f-81ab-e048e33b075f (07d393dd-819e-419f-81ab-e048e33b075f): created successfully
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1109d71f-2202-4139-b809-2476a6f277b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Flow 'volume_create_manager' (6ddae214-9c59-46af-a5cf-f60908e53a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dbe2599e-ee1a-44f5-83e0-6a7fbf42d4b7 tempest-TestInstancesWithCinderVolumes-1741469939 None] Created volume successfully.
Nov 07 02:50:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-8a17a125-5fdd-4954-bb7c-02dc1bc79bd6 req-920440f1-0c6a-4f55-89cb-a661b8e4caf9 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-8a17a125-5fdd-4954-bb7c-02dc1bc79bd6 req-920440f1-0c6a-4f55-89cb-a661b8e4caf9 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-8a17a125-5fdd-4954-bb7c-02dc1bc79bd6 req-920440f1-0c6a-4f55-89cb-a661b8e4caf9 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-8a17a125-5fdd-4954-bb7c-02dc1bc79bd6 req-920440f1-0c6a-4f55-89cb-a661b8e4caf9 tempest-TestInstancesWithCinderVolumes-1741469939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-07d393dd-819e-419f-81ab-e048e33b075f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '433fcda0-1af6-476a-bcb9-781c71c18f78', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:50:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-8a17a125-5fdd-4954-bb7c-02dc1bc79bd6 req-920440f1-0c6a-4f55-89cb-a661b8e4caf9 tempest-TestInstancesWithCinderVolumes-1741469939 None] attachment_update completed successfully.
Nov 07 02:50:17 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=19,cinder:UPDATE=11,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:50:17 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=17,cinder:UPDATE=13,cinder:INSERT=7 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:50:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-3a1e3285-d470-47b0-89a7-9a2d5eb472b4 req-017cbe8c-5302-4312-acc7-eb2b4091d75b tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-3a1e3285-d470-47b0-89a7-9a2d5eb472b4 req-017cbe8c-5302-4312-acc7-eb2b4091d75b tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-3a1e3285-d470-47b0-89a7-9a2d5eb472b4 req-017cbe8c-5302-4312-acc7-eb2b4091d75b tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:37 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-3a1e3285-d470-47b0-89a7-9a2d5eb472b4 req-017cbe8c-5302-4312-acc7-eb2b4091d75b tempest-TestInstancesWithCinderVolumes-1741469939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35c3298e-0cd9-4de4-82e4-5fef89743865', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:50:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-3a1e3285-d470-47b0-89a7-9a2d5eb472b4 req-017cbe8c-5302-4312-acc7-eb2b4091d75b tempest-TestInstancesWithCinderVolumes-1741469939 None] attachment_update completed successfully.
Nov 07 02:50:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-a4fc0f14-0091-4965-bf0c-1c2a1a8428c1 req-cf95268c-9bfa-46e4-98fd-2d049bfc1974 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-a4fc0f14-0091-4965-bf0c-1c2a1a8428c1 req-cf95268c-9bfa-46e4-98fd-2d049bfc1974 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [req-a4fc0f14-0091-4965-bf0c-1c2a1a8428c1 req-cf95268c-9bfa-46e4-98fd-2d049bfc1974 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-a4fc0f14-0091-4965-bf0c-1c2a1a8428c1 req-cf95268c-9bfa-46e4-98fd-2d049bfc1974 tempest-TestInstancesWithCinderVolumes-1741469939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c', 'name': 'volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f800c67-d1e2-4f49-9cf1-2e98e9b32834', 'enforce_multipath': True} {{(pid=87087) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:50:40 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-a4fc0f14-0091-4965-bf0c-1c2a1a8428c1 req-cf95268c-9bfa-46e4-98fd-2d049bfc1974 tempest-TestInstancesWithCinderVolumes-1741469939 None] attachment_update completed successfully.
Nov 07 02:50:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-cbb2d4fd-da9a-49dd-a5e5-220123d7c2ee req-065fcbcc-152e-434b-8018-5f25102920d5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Terminate volume connection completed successfully.
Nov 07 02:50:44 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-cbb2d4fd-da9a-49dd-a5e5-220123d7c2ee req-065fcbcc-152e-434b-8018-5f25102920d5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Deleting attachment 35c3298e-0cd9-4de4-82e4-5fef89743865. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:50:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "cinder-ac43247a-b59d-4d9f-96c0-c3cf91df05b7-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-ac43247a-b59d-4d9f-96c0-c3cf91df05b7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "cinder-quobyte-ac43247a-b59d-4d9f-96c0-c3cf91df05b7" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-quobyte-ac43247a-b59d-4d9f-96c0-c3cf91df05b7" acquired by "delete_volume" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ca2f1e-a3f5-44bf-9cbb-689397947999]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:45 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7
Nov 07 02:50:45 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:45 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7" returned: 0 in 0.361s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:45 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7
Nov 07 02:50:45 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:45 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ac43247a-b59d-4d9f-96c0-c3cf91df05b7" returned: 0 in 0.252s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-quobyte-ac43247a-b59d-4d9f-96c0-c3cf91df05b7" released by "delete_volume" :: held 0.661s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:45 devstack cinder-volume[87087]: WARNING cinder.quota [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-59541642-1971544233 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-59541642-1971544233, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:50:45 devstack cinder-volume[87087]: WARNING cinder.quota [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-59541642-1971544233 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-59541642-1971544233, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Created reservations ['29c9c953-2a1a-4faa-93ea-947fb0ad642d', '0ba49d0a-332e-432c-8646-5a1abfd31d1c', '31f759e9-f007-441e-af90-c41d9a15f048', '84baa7df-0978-45aa-9e27-8443878d2441'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:45 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:50:45 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:46 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.252s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:46 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Deleted volume successfully.
Nov 07 02:50:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-cf4c2917-7d4b-4750-a780-213bfbf12ac5 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-ac43247a-b59d-4d9f-96c0-c3cf91df05b7-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-1281cee4-2608-4b5c-bd00-e3e100b49888 req-c27f34b2-9ce1-44d7-a2a0-7629af75d477 tempest-TestInstancesWithCinderVolumes-1741469939 None] Terminate volume connection completed successfully.
Nov 07 02:50:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-1281cee4-2608-4b5c-bd00-e3e100b49888 req-c27f34b2-9ce1-44d7-a2a0-7629af75d477 tempest-TestInstancesWithCinderVolumes-1741469939 None] Deleting attachment 5f800c67-d1e2-4f49-9cf1-2e98e9b32834. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:50:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "cinder-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "cinder-quobyte-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-quobyte-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:49 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5defc26d-03f7-4d7f-a1a4-ab1aeccc1942]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:49 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521
Nov 07 02:50:49 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:49 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:49 devstack sudo[106174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521
Nov 07 02:50:49 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:50 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521" returned: 0 in 0.242s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-quobyte-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521" released by "delete_volume" :: held 0.676s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:50 devstack cinder-volume[87087]: WARNING cinder.quota [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455364844-830964223 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455364844-830964223, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:50:50 devstack cinder-volume[87087]: WARNING cinder.quota [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455364844-830964223 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455364844-830964223, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Created reservations ['322efccd-3fd4-434c-a488-150c9c7b7292', '80d6dd4e-48cc-482e-b87a-9e40e8f15d1e', '0b913982-dd81-4384-88df-74b280a8cbeb', '1c82103d-383a-4b05-b324-b3cb936a36b8'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:50 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:50:50 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:50 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.263s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Deleted volume successfully.
Nov 07 02:50:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2a469810-dc00-4f20-a632-0862cb74362b tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-e9c4a0cc-1c8e-45d3-aeb8-aaaf37a5a521-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [req-83e17d82-68b1-4c20-bf3b-9a48868a7e93 req-4893c50c-d7a5-4e90-95b7-52e94d7b5662 tempest-TestInstancesWithCinderVolumes-1741469939 None] Terminate volume connection completed successfully.
Nov 07 02:50:52 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [req-83e17d82-68b1-4c20-bf3b-9a48868a7e93 req-4893c50c-d7a5-4e90-95b7-52e94d7b5662 tempest-TestInstancesWithCinderVolumes-1741469939 None] Deleting attachment 433fcda0-1af6-476a-bcb9-781c71c18f78. {{(pid=87087) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:53 devstack sudo[106210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:50:53 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:53 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.246s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:50:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "cinder-07d393dd-819e-419f-81ab-e048e33b075f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-07d393dd-819e-419f-81ab-e048e33b075f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "cinder-quobyte-07d393dd-819e-419f-81ab-e048e33b075f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-quobyte-07d393dd-819e-419f-81ab-e048e33b075f" acquired by "delete_volume" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[360f0060-90d0-4734-bbb5-5c1a051ac34f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:54 devstack sudo[106213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f
Nov 07 02:50:54 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:54 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:54 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f
Nov 07 02:50:54 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:54 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-07d393dd-819e-419f-81ab-e048e33b075f" returned: 0 in 0.244s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-quobyte-07d393dd-819e-419f-81ab-e048e33b075f" released by "delete_volume" :: held 0.631s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:54 devstack cinder-volume[87087]: WARNING cinder.quota [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-42722324-1259193000 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-42722324-1259193000, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:50:54 devstack cinder-volume[87087]: WARNING cinder.quota [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-42722324-1259193000 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-42722324-1259193000, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Created reservations ['ec0a5f04-128d-4923-b989-405ab564ffba', 'b3ea0a40-f282-440c-8c68-0fca6bd57e6a', 'ee1ce29e-087c-4d29-b5bb-481df4c9a7f8', '52a4aea0-ac16-418e-8634-ba84a0265d49'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:54 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:50:54 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:55 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.243s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:55 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Deleted volume successfully.
Nov 07 02:50:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-00edc3b9-8c58-4d75-8042-24ae9227df51 tempest-TestInstancesWithCinderVolumes-1741469939 None] Lock "cinder-07d393dd-819e-419f-81ab-e048e33b075f-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:04 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=31,cinder:SELECT=31,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:51:05 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=32,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (3dc9f7e7-489d-4122-ac8d-bbbe57321f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062282c1-1107-44fd-80f5-fcd81f63e13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062282c1-1107-44fd-80f5-fcd81f63e13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657459303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b49ecf-c42f-43d5-8836-244f9fc5a3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:07Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986cef86-8401-492a-b985-bf074c69066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986cef86-8401-492a-b985-bf074c69066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc5bbcc-aa8f-4699-9af3-f72b9c03cac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc5bbcc-aa8f-4699-9af3-f72b9c03cac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b49ecf-c42f-43d5-8836-244f9fc5a3ae', 'volume_name': 'volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bdd5d2-653d-4122-928a-00931a9387b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bdd5d2-653d-4122-928a-00931a9387b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d591637-382a-40d5-9587-557dd2d5f48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:06 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume 89b49ecf-c42f-43d5-8836-244f9fc5a3ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae', 'volume_size': 1}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657459303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b49ecf-c42f-43d5-8836-244f9fc5a3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:07Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Creating volume 89b49ecf-c42f-43d5-8836-244f9fc5a3ae {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:06 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:06 devstack sudo[106230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae 1073741824
Nov 07 02:51:06 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:07 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae 1073741824" returned: 0 in 0.412s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:07 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae
Nov 07 02:51:07 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:07 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae" returned: 0 in 0.247s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d591637-382a-40d5-9587-557dd2d5f48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f83203b-564a-4208-ab02-89e3daee8459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae (89b49ecf-c42f-43d5-8836-244f9fc5a3ae): created successfully
Nov 07 02:51:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f83203b-564a-4208-ab02-89e3daee8459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (3dc9f7e7-489d-4122-ac8d-bbbe57321f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-896dc42f-3aa8-4a59-a4cb-5a9dc50f2b4c tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created volume successfully.
Nov 07 02:51:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] Creating offline snapshot 2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a of volume 89b49ecf-c42f-43d5-8836-244f9fc5a3ae {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:51:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b620d7-4185-4420-bd70-8843b76f4e43]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:08 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae
Nov 07 02:51:08 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:08 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae" returned: 0 in 0.361s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:08 devstack sudo[106244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a 1G
Nov 07 02:51:08 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:08 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a 1G" returned: 0 in 0.400s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:08 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a
Nov 07 02:51:08 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:09 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:09 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a is being set with open permissions: ugo+rw
Nov 07 02:51:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:09 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a
Nov 07 02:51:09 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:09 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a" returned: 0 in 0.255s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:09 devstack sudo[106257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.info
Nov 07 02:51:09 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:09 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.info" returned: 0 in 0.243s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:09 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.info is being set with open permissions: ugo+rw
Nov 07 02:51:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:09 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.info
Nov 07 02:51:09 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:09 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.info" returned: 0 in 0.237s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-62944a61-590f-4ebc-ba69-7da49a0424dc tempest-CreateVolumesFromSnapshotTest-1166473877 None] Create snapshot completed successfully
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (e2cef22b-2a85-492f-a4e7-e59990e09833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebee384-c5f3-4051-bae5-a34214777cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebee384-c5f3-4051-bae5-a34214777cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726292507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40751c5c-93d3-4989-985e-6ea8372bd14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:11Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5670e4-05ae-4858-b2dd-665cc995452c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5670e4-05ae-4858-b2dd-665cc995452c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdb2ca0-1a35-435a-bb99-a874f6b0923e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdb2ca0-1a35-435a-bb99-a874f6b0923e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40751c5c-93d3-4989-985e-6ea8372bd14a', 'volume_name': 'volume-40751c5c-93d3-4989-985e-6ea8372bd14a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee97d11-255d-43b1-a7c2-234e3704d788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee97d11-255d-43b1-a7c2-234e3704d788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381cb99a-7e1e-4b10-9f38-47177b902739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:10 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume 40751c5c-93d3-4989-985e-6ea8372bd14a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40751c5c-93d3-4989-985e-6ea8372bd14a', 'volume_size': 1}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726292507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40751c5c-93d3-4989-985e-6ea8372bd14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:11Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Creating volume 40751c5c-93d3-4989-985e-6ea8372bd14a {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:10 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:10 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a 1073741824
Nov 07 02:51:10 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (acf019cb-b35b-4eef-9a8c-49c6970af07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77093aca-fd24-4813-a3e7-ab1e51157b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77093aca-fd24-4813-a3e7-ab1e51157b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1868937684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc73d8e-216d-465d-867c-fbd2e489e50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:11Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f821d31b-b786-49eb-95f9-7b1b7bc4943d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f821d31b-b786-49eb-95f9-7b1b7bc4943d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b1ee6b-c4ed-4ccf-89b7-90a6e428cd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b1ee6b-c4ed-4ccf-89b7-90a6e428cd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc73d8e-216d-465d-867c-fbd2e489e50b', 'volume_name': 'volume-8bc73d8e-216d-465d-867c-fbd2e489e50b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbfa404-7cd0-4bcf-aabb-92820d3f4eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbfa404-7cd0-4bcf-aabb-92820d3f4eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf8cc3d-a2ef-42a5-81a3-a5257d8d1bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume 8bc73d8e-216d-465d-867c-fbd2e489e50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc73d8e-216d-465d-867c-fbd2e489e50b', 'volume_size': 1}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:11 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a 1073741824" returned: 0 in 0.509s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:11 devstack sudo[106269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a
Nov 07 02:51:11 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (236afbde-0224-49a2-99ec-4f45a384c5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:11 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13176cac-967b-4222-9f7d-7aa55ff6176b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13176cac-967b-4222-9f7d-7aa55ff6176b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1645796286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68aca7d-a8f9-4899-98ab-f5cc08eb56ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:11Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1adc8e-c31c-4d41-b489-2dfe65002e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1adc8e-c31c-4d41-b489-2dfe65002e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58e42c6-051f-41be-8bd5-d9c8bf1d81a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58e42c6-051f-41be-8bd5-d9c8bf1d81a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e68aca7d-a8f9-4899-98ab-f5cc08eb56ac', 'volume_name': 'volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d51f99-4d17-4600-a028-99d3b2af14e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d51f99-4d17-4600-a028-99d3b2af14e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ac19d4-fc60-44ca-b9c3-f097d9de6d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume e68aca7d-a8f9-4899-98ab-f5cc08eb56ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac', 'volume_size': 1}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a" returned: 0 in 0.299s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.421s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1868937684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc73d8e-216d-465d-867c-fbd2e489e50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:11Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Creating volume 8bc73d8e-216d-465d-867c-fbd2e489e50b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:11 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381cb99a-7e1e-4b10-9f38-47177b902739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40751c5c-93d3-4989-985e-6ea8372bd14a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b 1073741824
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1afe75b-0329-48e8-88fd-92779739d237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume volume-40751c5c-93d3-4989-985e-6ea8372bd14a (40751c5c-93d3-4989-985e-6ea8372bd14a): created successfully
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1afe75b-0329-48e8-88fd-92779739d237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (e2cef22b-2a85-492f-a4e7-e59990e09833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9243a8cb-deef-430d-90e9-88069b926ac3 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created volume successfully.
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (7e2375f9-e80d-473a-979d-752e84ce80bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c5c573-7f8a-4a04-bbd9-243e75d3422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c5c573-7f8a-4a04-bbd9-243e75d3422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1308035714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2020f903-b138-449e-973d-69ae22d9ffd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:12Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a53338-cc85-49bb-a207-755715cdeed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a53338-cc85-49bb-a207-755715cdeed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8f325b-dbf8-4d5d-8969-344a6700eeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8f325b-dbf8-4d5d-8969-344a6700eeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2020f903-b138-449e-973d-69ae22d9ffd8', 'volume_name': 'volume-2020f903-b138-449e-973d-69ae22d9ffd8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6def763-49ad-4188-817c-d43ef838ac0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6def763-49ad-4188-817c-d43ef838ac0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d34a55-71d5-4598-aadb-a9c35c5889be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume 2020f903-b138-449e-973d-69ae22d9ffd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2020f903-b138-449e-973d-69ae22d9ffd8', 'volume_size': 1}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:12 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b 1073741824" returned: 0 in 0.552s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:12 devstack sudo[106280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b
Nov 07 02:51:12 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (076b7024-3259-42e6-a87a-95a757e6b3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01799be8-865c-4bf1-b7f6-370def2a2d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01799be8-865c-4bf1-b7f6-370def2a2d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-35520917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4544366c-798c-4d05-9038-bc664398fe5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:12Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e23e33-9944-4842-a619-53ff35a6cc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e23e33-9944-4842-a619-53ff35a6cc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2079eae0-cd02-4857-802d-a832690fe0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2079eae0-cd02-4857-802d-a832690fe0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4544366c-798c-4d05-9038-bc664398fe5b', 'volume_name': 'volume-4544366c-798c-4d05-9038-bc664398fe5b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d939e1fc-94db-494c-ab82-c92d03870ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d939e1fc-94db-494c-ab82-c92d03870ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c748867a-c47f-47f7-8173-c39efe246730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume 4544366c-798c-4d05-9038-bc664398fe5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4544366c-798c-4d05-9038-bc664398fe5b', 'volume_size': 1}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:12 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1645796286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68aca7d-a8f9-4899-98ab-f5cc08eb56ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:11Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Creating volume e68aca7d-a8f9-4899-98ab-f5cc08eb56ac {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:12 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf8cc3d-a2ef-42a5-81a3-a5257d8d1bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc73d8e-216d-465d-867c-fbd2e489e50b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac 1073741824
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0e2c12-c042-47be-ad17-753cf3e67d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume volume-8bc73d8e-216d-465d-867c-fbd2e489e50b (8bc73d8e-216d-465d-867c-fbd2e489e50b): created successfully
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0e2c12-c042-47be-ad17-753cf3e67d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (acf019cb-b35b-4eef-9a8c-49c6970af07c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5cf13a0d-66c2-4de0-b0d4-f157fc1e7443 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created volume successfully.
Nov 07 02:51:12 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac 1073741824" returned: 0 in 0.443s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:13 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac
Nov 07 02:51:13 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:13 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac" returned: 0 in 0.241s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.198s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1308035714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2020f903-b138-449e-973d-69ae22d9ffd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:12Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Creating volume 2020f903-b138-449e-973d-69ae22d9ffd8 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:13 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ac19d4-fc60-44ca-b9c3-f097d9de6d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack sudo[106292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8 1073741824
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d890e4-94b0-424d-b6e4-b686d9256578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac (e68aca7d-a8f9-4899-98ab-f5cc08eb56ac): created successfully
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d890e4-94b0-424d-b6e4-b686d9256578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (236afbde-0224-49a2-99ec-4f45a384c5b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4b04d686-47ea-4cae-8f35-8c20bf17642f tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created volume successfully.
Nov 07 02:51:13 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8 1073741824" returned: 0 in 0.418s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:13 devstack sudo[106297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8
Nov 07 02:51:13 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:13 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8" returned: 0 in 0.243s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.527s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-35520917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4544366c-798c-4d05-9038-bc664398fe5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00212a5db8cd46d6855ab0bb88493d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:12Z,use_quota=True,user_id='7044507a82d24aac90826b9da71391bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Creating volume 4544366c-798c-4d05-9038-bc664398fe5b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:13 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d34a55-71d5-4598-aadb-a9c35c5889be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2020f903-b138-449e-973d-69ae22d9ffd8', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b 1073741824
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ed7d89-193f-4c0a-b0e7-fee949245f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume volume-2020f903-b138-449e-973d-69ae22d9ffd8 (2020f903-b138-449e-973d-69ae22d9ffd8): created successfully
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ed7d89-193f-4c0a-b0e7-fee949245f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (7e2375f9-e80d-473a-979d-752e84ce80bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-cbb17352-eef5-4b55-b52a-320904fa0b90 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created volume successfully.
Nov 07 02:51:14 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b 1073741824" returned: 0 in 0.406s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:14 devstack sudo[106305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b
Nov 07 02:51:14 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:14 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b" returned: 0 in 0.257s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c748867a-c47f-47f7-8173-c39efe246730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4544366c-798c-4d05-9038-bc664398fe5b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6fc929-8a1e-45b5-ab64-1bbd20842564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Volume volume-4544366c-798c-4d05-9038-bc664398fe5b (4544366c-798c-4d05-9038-bc664398fe5b): created successfully
Nov 07 02:51:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6fc929-8a1e-45b5-ab64-1bbd20842564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Flow 'volume_create_manager' (076b7024-3259-42e6-a87a-95a757e6b3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7f5f6a76-fd08-42ef-8a65-72948bd50789 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created volume successfully.
Nov 07 02:51:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-4544366c-798c-4d05-9038-bc664398fe5b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-4544366c-798c-4d05-9038-bc664398fe5b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-quobyte-4544366c-798c-4d05-9038-bc664398fe5b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-4544366c-798c-4d05-9038-bc664398fe5b" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:15 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9272091f-f2c1-4b90-baa0-9346b165074e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:15 devstack sudo[106308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b
Nov 07 02:51:15 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:16 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b" returned: 0 in 0.355s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:16 devstack sudo[106313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b
Nov 07 02:51:16 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:16 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4544366c-798c-4d05-9038-bc664398fe5b" returned: 0 in 0.244s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-4544366c-798c-4d05-9038-bc664398fe5b" released by "delete_volume" :: held 0.637s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created reservations ['2f94c396-5d8f-4656-99bb-72da1a742f5d', '792855af-0225-442d-9a9c-f6ec6a62e35f', '432902ad-18f0-4add-a743-4d056ce3cb88', '30df12fb-060e-459e-8141-e8950f366761'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:16 devstack sudo[106316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:51:16 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:16 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.245s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Deleted volume successfully.
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-816cbab6-183e-4c3c-a69d-7fec17f0648b tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-4544366c-798c-4d05-9038-bc664398fe5b-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-2020f903-b138-449e-973d-69ae22d9ffd8-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-2020f903-b138-449e-973d-69ae22d9ffd8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-quobyte-2020f903-b138-449e-973d-69ae22d9ffd8" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-2020f903-b138-449e-973d-69ae22d9ffd8" acquired by "delete_volume" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d17ff3-a4e0-4499-bb2d-d0cdf178831d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:17 devstack sudo[106319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8
Nov 07 02:51:17 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:17 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8" returned: 0 in 0.371s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:17 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8
Nov 07 02:51:17 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:17 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-2020f903-b138-449e-973d-69ae22d9ffd8" returned: 0 in 0.247s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-2020f903-b138-449e-973d-69ae22d9ffd8" released by "delete_volume" :: held 0.660s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created reservations ['f1947c05-6e42-4714-a542-52180ef97948', '12299e4a-7d3b-45a3-a1dc-65403febdf12', '37b2cf81-cdb7-4c77-90e9-75a08c123a08', '7170c874-d301-4f5a-a60f-7e2514b87ac6'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:17 devstack sudo[106327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:51:17 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:17 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Deleted volume successfully.
Nov 07 02:51:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-c14ba277-ecd2-487a-80ad-85f65ceb8169 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-2020f903-b138-449e-973d-69ae22d9ffd8-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-quobyte-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fd6002-88fe-4f59-99a0-5c4d560ee0b2]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:18 devstack sudo[106330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac
Nov 07 02:51:18 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:18 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:18 devstack sudo[106336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac
Nov 07 02:51:18 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:18 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac" returned: 0 in 0.244s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac" released by "delete_volume" :: held 0.635s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created reservations ['2a42e790-a4d8-4583-b75e-9447678f09d5', 'f265ddcc-2c6c-4bb8-944e-12c46679c3b1', '228e6bff-19cd-4fcf-866d-34499e62501f', '95e70f5b-ecbc-41d2-8fbe-6b4a1f7ba2c3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:18 devstack sudo[106339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:51:18 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:19 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.244s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Deleted volume successfully.
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8dbd202d-9c19-4317-a6d8-0c5a4a30cf49 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-e68aca7d-a8f9-4899-98ab-f5cc08eb56ac-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-8bc73d8e-216d-465d-867c-fbd2e489e50b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-8bc73d8e-216d-465d-867c-fbd2e489e50b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-quobyte-8bc73d8e-216d-465d-867c-fbd2e489e50b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-8bc73d8e-216d-465d-867c-fbd2e489e50b" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e192acb-f911-4d7f-9762-9038b5216209]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:19 devstack sudo[106342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b
Nov 07 02:51:19 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:19 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b" returned: 0 in 0.342s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:19 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b
Nov 07 02:51:19 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:19 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-8bc73d8e-216d-465d-867c-fbd2e489e50b" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-8bc73d8e-216d-465d-867c-fbd2e489e50b" released by "delete_volume" :: held 0.630s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created reservations ['d133a183-7e3b-402c-9a18-c447fe970c65', '479cefc7-d4c4-4f4e-a123-9d306e4f5677', '171c54b2-ff19-42ff-9d4f-bb1a9f45e1db', '1e434949-70f1-479a-8a2a-7562c505cc6b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:19 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:51:19 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:20 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:20 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Deleted volume successfully.
Nov 07 02:51:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-668ff760-a5e2-4f86-84cf-b7768fe57d02 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-8bc73d8e-216d-465d-867c-fbd2e489e50b-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-40751c5c-93d3-4989-985e-6ea8372bd14a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-40751c5c-93d3-4989-985e-6ea8372bd14a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-quobyte-40751c5c-93d3-4989-985e-6ea8372bd14a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-40751c5c-93d3-4989-985e-6ea8372bd14a" acquired by "delete_volume" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:20 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9eb2834-168c-450d-98ff-d5afbb8da349]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:20 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a
Nov 07 02:51:20 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:20 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a" returned: 0 in 0.359s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:20 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a
Nov 07 02:51:20 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:21 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-40751c5c-93d3-4989-985e-6ea8372bd14a" returned: 0 in 0.249s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-40751c5c-93d3-4989-985e-6ea8372bd14a" released by "delete_volume" :: held 0.646s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created reservations ['840e632c-3af2-4c99-93e6-23ef5035536f', '47a1677b-322e-42ca-8f1b-79e77645209e', 'c10c0eb5-371d-456d-b45f-cf66576a874f', '97a2d0a1-acb0-4ce7-8494-9b6664df4323'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:21 devstack sudo[106361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:51:21 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:21 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.244s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Deleted volume successfully.
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b7767c6c-43b2-4714-b171-6a15d2b103c9 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-40751c5c-93d3-4989-985e-6ea8372bd14a-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-quobyte-89b49ecf-c42f-43d5-8836-244f9fc5a3ae" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-89b49ecf-c42f-43d5-8836-244f9fc5a3ae" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-quobyte-2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Deleting offline snapshot 2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a of volume 89b49ecf-c42f-43d5-8836-244f9fc5a3ae {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] snapshot_file for this snap is: volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f760dcd-f60e-4bf7-a44a-b1419504d791]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:21 devstack sudo[106364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a
Nov 07 02:51:21 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:21 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a" returned: 0 in 0.347s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33bb5c8-f73f-4f9e-b735-96ba8aaacb4a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:22 devstack sudo[106369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae
Nov 07 02:51:22 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:22 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:22 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a
Nov 07 02:51:22 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:22 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:22 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a
Nov 07 02:51:22 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:22 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae.2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a" returned: 0 in 0.238s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a" released by "_delete_snapshot" :: held 1.369s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-89b49ecf-c42f-43d5-8836-244f9fc5a3ae" released by "delete_snapshot" :: held 1.393s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:22 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created reservations ['b94abf4a-413e-4af5-a96e-96fe32377d20', '8c993c6e-a232-4720-b6fc-beb44a66d15b', 'a3426aae-f9dc-404c-928c-e23d263fb8ee', '895d1c6c-2ca3-43d5-a8e1-868902151323'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Delete snapshot completed successfully.
Nov 07 02:51:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-2f1e97d9-ebcb-412d-97a1-ba5e1ebdb12d tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-2b2a09d0-7ef7-4c5b-8506-5af8b1c2f63a-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-89b49ecf-c42f-43d5-8836-244f9fc5a3ae-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-89b49ecf-c42f-43d5-8836-244f9fc5a3ae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "cinder-quobyte-89b49ecf-c42f-43d5-8836-244f9fc5a3ae" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-89b49ecf-c42f-43d5-8836-244f9fc5a3ae" acquired by "delete_volume" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ca8b8c-89c4-49fd-9c78-721972605289]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:23 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae
Nov 07 02:51:23 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:24 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:24 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae
Nov 07 02:51:24 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:24 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-89b49ecf-c42f-43d5-8836-244f9fc5a3ae" returned: 0 in 0.236s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-quobyte-89b49ecf-c42f-43d5-8836-244f9fc5a3ae" released by "delete_volume" :: held 0.653s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Created reservations ['83f16809-a3c1-4b5c-b4c7-9c55d9b32dd4', '847a1e10-70a8-4a98-9b41-24f2415ec288', '16a89fb8-bcb5-47b8-9a0f-192e8c95c884', '0ecd3682-9574-4656-965e-f67d21f24e0f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:24 devstack sudo[106390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:51:24 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:24 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Deleted volume successfully.
Nov 07 02:51:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-e48e9250-b353-47cd-838a-376be24c6720 tempest-CreateVolumesFromSnapshotTest-1166473877 None] Lock "cinder-89b49ecf-c42f-43d5-8836-244f9fc5a3ae-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Flow 'volume_create_manager' (fbaa9b7b-91b1-43ec-a9ce-fa249a3d9cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35cf7fc-cb38-4418-892d-c98b882dd686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35cf7fc-cb38-4418-892d-c98b882dd686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855063834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6213e4f1-4350-4527-9292-307ecf7fd526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4e2527ee1c4cfdbe1019f6d3c8bbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:28Z,use_quota=True,user_id='05ebbd58953f4fd3b1b9153625246177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8307dcfe-59ae-4913-85e1-c7daa41c65b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8307dcfe-59ae-4913-85e1-c7daa41c65b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7d9fd9-8db7-48da-a75b-d3402f7d9bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7d9fd9-8db7-48da-a75b-d3402f7d9bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6213e4f1-4350-4527-9292-307ecf7fd526', 'volume_name': 'volume-6213e4f1-4350-4527-9292-307ecf7fd526', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ad0950-e043-4e7b-97aa-e684c891bbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ad0950-e043-4e7b-97aa-e684c891bbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccd75ee-fb55-4540-bff3-efed65e690ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:27 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Volume 6213e4f1-4350-4527-9292-307ecf7fd526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6213e4f1-4350-4527-9292-307ecf7fd526', 'volume_size': 1}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855063834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6213e4f1-4350-4527-9292-307ecf7fd526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4e2527ee1c4cfdbe1019f6d3c8bbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:28Z,use_quota=True,user_id='05ebbd58953f4fd3b1b9153625246177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Creating volume 6213e4f1-4350-4527-9292-307ecf7fd526 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:27 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:28 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526 1073741824
Nov 07 02:51:28 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:28 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526 1073741824" returned: 0 in 0.414s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:28 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526
Nov 07 02:51:28 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:28 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526" returned: 0 in 0.243s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccd75ee-fb55-4540-bff3-efed65e690ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6213e4f1-4350-4527-9292-307ecf7fd526', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b690fd16-1311-4d7a-9b6e-b8ba699e38fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Volume volume-6213e4f1-4350-4527-9292-307ecf7fd526 (6213e4f1-4350-4527-9292-307ecf7fd526): created successfully
Nov 07 02:51:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b690fd16-1311-4d7a-9b6e-b8ba699e38fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Flow 'volume_create_manager' (fbaa9b7b-91b1-43ec-a9ce-fa249a3d9cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-db01b5c7-3d81-4b94-9971-5bd527c84199 tempest-ProjectReaderTests-461517691 None] Created volume successfully.
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Acquiring lock "cinder-6213e4f1-4350-4527-9292-307ecf7fd526-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Lock "cinder-6213e4f1-4350-4527-9292-307ecf7fd526-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Acquiring lock "cinder-quobyte-6213e4f1-4350-4527-9292-307ecf7fd526" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Lock "cinder-quobyte-6213e4f1-4350-4527-9292-307ecf7fd526" acquired by "delete_volume" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb50c190-6adc-4ec5-a57d-3657542b3f62]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:29 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526
Nov 07 02:51:29 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:29 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526" returned: 0 in 0.375s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:29 devstack sudo[106410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526
Nov 07 02:51:29 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:29 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6213e4f1-4350-4527-9292-307ecf7fd526" returned: 0 in 0.254s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Lock "cinder-quobyte-6213e4f1-4350-4527-9292-307ecf7fd526" released by "delete_volume" :: held 0.669s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Created reservations ['8391ec69-b19a-4466-baf5-4a476ac3cf62', '0505bbde-6d5d-4473-bb5d-2dc8e9fbfcc7', '9bf857aa-dc67-4914-a5d8-1c665f8f92a1', '6a2cd302-f561-4c8f-a34b-83a629b6816e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:29 devstack sudo[106413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:51:29 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:30 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.244s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:30 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Deleted volume successfully.
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9133ef20-8258-48be-b953-4cb5fe6a5c53 tempest-ProjectReaderTests-461517691 None] Lock "cinder-6213e4f1-4350-4527-9292-307ecf7fd526-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Flow 'volume_create_manager' (0f9a65a2-d9e2-48f8-83f4-3d3c0cdafa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb22957-e5ec-468a-a9ec-47b08c9038ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb22957-e5ec-468a-a9ec-47b08c9038ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2106830818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d35809e-6686-4f3b-bcfe-8ef3442ad93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4e2527ee1c4cfdbe1019f6d3c8bbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:31Z,use_quota=True,user_id='05ebbd58953f4fd3b1b9153625246177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407f4f28-ffb9-4242-a422-23a6db842477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407f4f28-ffb9-4242-a422-23a6db842477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ef1893-43ea-4d8c-86f2-4a1badf614e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ef1893-43ea-4d8c-86f2-4a1badf614e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d35809e-6686-4f3b-bcfe-8ef3442ad93a', 'volume_name': 'volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff2bb6e-2456-4657-90d2-c3dfa854de11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff2bb6e-2456-4657-90d2-c3dfa854de11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b456e794-cf75-47aa-9b88-869f45ec2b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:30 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Volume 5d35809e-6686-4f3b-bcfe-8ef3442ad93a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a', 'volume_size': 1}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2106830818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d35809e-6686-4f3b-bcfe-8ef3442ad93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4e2527ee1c4cfdbe1019f6d3c8bbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:31Z,use_quota=True,user_id='05ebbd58953f4fd3b1b9153625246177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Creating volume 5d35809e-6686-4f3b-bcfe-8ef3442ad93a {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:30 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:30 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a 1073741824
Nov 07 02:51:30 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:31 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a 1073741824" returned: 0 in 0.396s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:31 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a
Nov 07 02:51:31 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:31 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a" returned: 0 in 0.244s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b456e794-cf75-47aa-9b88-869f45ec2b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89339f7-e9f1-4527-95a8-eae28149efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:31 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Volume volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a (5d35809e-6686-4f3b-bcfe-8ef3442ad93a): created successfully
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89339f7-e9f1-4527-95a8-eae28149efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Flow 'volume_create_manager' (0f9a65a2-d9e2-48f8-83f4-3d3c0cdafa81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c146635f-64de-48a4-9745-8c58f255a0d1 tempest-ProjectReaderTests-461517691 None] Created volume successfully.
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Acquiring lock "cinder-5d35809e-6686-4f3b-bcfe-8ef3442ad93a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Lock "cinder-5d35809e-6686-4f3b-bcfe-8ef3442ad93a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Acquiring lock "cinder-quobyte-5d35809e-6686-4f3b-bcfe-8ef3442ad93a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Lock "cinder-quobyte-5d35809e-6686-4f3b-bcfe-8ef3442ad93a" acquired by "delete_volume" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fb02cb-72e7-4e14-a75a-8a725da1e7b3]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:31 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a
Nov 07 02:51:31 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:32 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:32 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a
Nov 07 02:51:32 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:32 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5d35809e-6686-4f3b-bcfe-8ef3442ad93a" returned: 0 in 0.234s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Lock "cinder-quobyte-5d35809e-6686-4f3b-bcfe-8ef3442ad93a" released by "delete_volume" :: held 0.622s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Created reservations ['ccf8506c-b153-4afa-b343-128c43fd2d46', 'b43c36be-8f20-48f7-9a3f-1492d3072a30', '7746b0a2-b77f-4da9-80ab-2097891025d6', '9be47864-514a-4b51-ac89-ee0cae0a4be2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:32 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:51:32 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:32 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.236s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:32 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Deleted volume successfully.
Nov 07 02:51:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-18bd906e-fb56-4f90-aad6-7f63732c4d10 tempest-ProjectReaderTests-461517691 None] Lock "cinder-5d35809e-6686-4f3b-bcfe-8ef3442ad93a-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:42 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=94,cinder:SELECT=71,cinder:DELETE=9,cinder:INSERT=19 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:51:42 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=59,cinder:UPDATE=96,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (da06cbd3-1af7-4a61-878b-824252ea488d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b223fb13-a7dc-4a91-b627-25e7cb15465f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b223fb13-a7dc-4a91-b627-25e7cb15465f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112266783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:53Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991d42a7-1c2e-46b2-a60b-1003e019376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991d42a7-1c2e-46b2-a60b-1003e019376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8307b972-2966-4be8-a94f-3ee91b3d80b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8307b972-2966-4be8-a94f-3ee91b3d80b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af', 'volume_name': 'volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16807b20-749b-46d7-bf7d-0021d0def087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16807b20-749b-46d7-bf7d-0021d0def087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b91d17-f387-48ea-a0b5-9a3b342813b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af', 'volume_size': 1}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112266783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:53Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Creating volume fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:53 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:53 devstack sudo[106519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af 1073741824
Nov 07 02:51:53 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:53 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:51:53 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Flow 'volume_create_manager' (93eab230-1c91-4aa4-ab01-680f1de5c6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a1318b-981b-4a6d-acba-452a72f86c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a1318b-981b-4a6d-acba-452a72f86c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641278866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2726609-7cc5-4754-acb8-6d72249e91d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b908474c9084399824d70e34c5f5a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:53Z,use_quota=True,user_id='2a42cbe6a09d426faa506eb4240eb986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af51a913-59ef-4128-aeaf-5967d9778ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af51a913-59ef-4128-aeaf-5967d9778ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d21b65-1aef-4d5c-9cca-fdeae020aa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d21b65-1aef-4d5c-9cca-fdeae020aa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2726609-7cc5-4754-acb8-6d72249e91d4', 'volume_name': 'volume-f2726609-7cc5-4754-acb8-6d72249e91d4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2c9deb-2af2-40e7-9cc2-be26f6a08c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2c9deb-2af2-40e7-9cc2-be26f6a08c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3fddca-1de8-4e1d-aa06-e0a1e59a1182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Volume f2726609-7cc5-4754-acb8-6d72249e91d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2726609-7cc5-4754-acb8-6d72249e91d4', 'volume_size': 1}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:53 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.377s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:51:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (564d9044-a01f-41a8-9cfa-44083a384769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311a16d9-438c-40fa-b48d-e1627ba1cd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311a16d9-438c-40fa-b48d-e1627ba1cd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948188057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800144a9-e1c0-4018-a478-0d7d70f03fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:54Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c63e6b6-966f-4626-8d24-a7dde790172f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c63e6b6-966f-4626-8d24-a7dde790172f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2a2669-9424-4d04-8636-99a8216c1afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2a2669-9424-4d04-8636-99a8216c1afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800144a9-e1c0-4018-a478-0d7d70f03fdc', 'volume_name': 'volume-800144a9-e1c0-4018-a478-0d7d70f03fdc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378016f1-2630-4640-8b29-f24be88608e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378016f1-2630-4640-8b29-f24be88608e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8483724-8335-4a94-aaff-9e23da6822d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume 800144a9-e1c0-4018-a478-0d7d70f03fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800144a9-e1c0-4018-a478-0d7d70f03fdc', 'volume_size': 1}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af 1073741824" returned: 0 in 0.816s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Flow 'volume_create_manager' (6698cc53-69ed-4de4-abe7-4a219319a037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01eab986-375f-486c-907b-7a6f50f79ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01eab986-375f-486c-907b-7a6f50f79ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-114500364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840897b7-1f0a-4016-b611-c8af27d5a062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b908474c9084399824d70e34c5f5a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:54Z,use_quota=True,user_id='2a42cbe6a09d426faa506eb4240eb986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190f9fb8-2906-4560-8b3e-03137f83aacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190f9fb8-2906-4560-8b3e-03137f83aacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f0a2f4-9775-46ba-9c0e-56d7863d8d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f0a2f4-9775-46ba-9c0e-56d7863d8d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '840897b7-1f0a-4016-b611-c8af27d5a062', 'volume_name': 'volume-840897b7-1f0a-4016-b611-c8af27d5a062', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5865303b-5e32-4d8a-abf0-a72af7eb5900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5865303b-5e32-4d8a-abf0-a72af7eb5900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de6416d-cb84-4a02-a8c2-7c2ff1f39dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Volume 840897b7-1f0a-4016-b611-c8af27d5a062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-840897b7-1f0a-4016-b611-c8af27d5a062', 'volume_size': 1}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:54 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af
Nov 07 02:51:54 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Flow 'volume_create_manager' (7ec954ea-f0bf-453f-8ae2-fd78f65e5e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56a358a-b0e3-44de-ad5a-657c36c6b6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56a358a-b0e3-44de-ad5a-657c36c6b6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2019492625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df21519-b619-4d26-b1bd-18495bd1ca9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b908474c9084399824d70e34c5f5a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:54Z,use_quota=True,user_id='2a42cbe6a09d426faa506eb4240eb986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8478ae68-ec58-49f5-bbd1-e01bbbe20db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8478ae68-ec58-49f5-bbd1-e01bbbe20db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb364e9c-7aaa-445f-85fb-cabe91813010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb364e9c-7aaa-445f-85fb-cabe91813010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df21519-b619-4d26-b1bd-18495bd1ca9e', 'volume_name': 'volume-6df21519-b619-4d26-b1bd-18495bd1ca9e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d09866-9817-437a-87c7-2104071a6f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d09866-9817-437a-87c7-2104071a6f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c5c727-5c01-4b91-a156-2013de31c94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Volume 6df21519-b619-4d26-b1bd-18495bd1ca9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df21519-b619-4d26-b1bd-18495bd1ca9e', 'volume_size': 1}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:54 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af" returned: 0 in 0.370s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.094s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641278866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2726609-7cc5-4754-acb8-6d72249e91d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b908474c9084399824d70e34c5f5a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:53Z,use_quota=True,user_id='2a42cbe6a09d426faa506eb4240eb986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Creating volume f2726609-7cc5-4754-acb8-6d72249e91d4 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:54 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:54 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4 1073741824
Nov 07 02:51:54 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b91d17-f387-48ea-a0b5-9a3b342813b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2e588c-9206-46a9-a79c-2f4d54264211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af (fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af): created successfully
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2e588c-9206-46a9-a79c-2f4d54264211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (da06cbd3-1af7-4a61-878b-824252ea488d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2d67fd14-081f-40de-b536-43beac65ecc8 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created volume successfully.
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Flow 'volume_create_manager' (aad51b4f-2262-4de0-a866-fdaae33ea4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fa8f87-715b-442b-b5d8-0c83538b725e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fa8f87-715b-442b-b5d8-0c83538b725e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-558278963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007d8c51-c9b0-4c7d-aad5-33feea48ba3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b908474c9084399824d70e34c5f5a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:55Z,use_quota=True,user_id='2a42cbe6a09d426faa506eb4240eb986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ceb5d5a-2df2-4fbb-865d-bdbfa776cfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ceb5d5a-2df2-4fbb-865d-bdbfa776cfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53d62e7-d990-487a-b72a-2bcb1f9fb973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53d62e7-d990-487a-b72a-2bcb1f9fb973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '007d8c51-c9b0-4c7d-aad5-33feea48ba3e', 'volume_name': 'volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec320320-b9ff-41b0-8257-9c056b1a2a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec320320-b9ff-41b0-8257-9c056b1a2a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05618b9-893c-407b-ac9a-0c9bacce5bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Volume 007d8c51-c9b0-4c7d-aad5-33feea48ba3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e', 'volume_size': 1}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:55 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4 1073741824" returned: 0 in 0.606s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Flow 'volume_create_manager' (0df36cdf-c442-4111-8aa1-a652d234d6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6234115b-afe2-49e8-a3e4-42afc32e50e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6234115b-afe2-49e8-a3e4-42afc32e50e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-397184098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d087802-9024-471f-aeb6-8020d94c4e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b908474c9084399824d70e34c5f5a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:55Z,use_quota=True,user_id='2a42cbe6a09d426faa506eb4240eb986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cc54a4-589c-4255-ab4c-e79265729bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cc54a4-589c-4255-ab4c-e79265729bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5109f929-2ad6-49cb-a364-8ddd4064c6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5109f929-2ad6-49cb-a364-8ddd4064c6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d087802-9024-471f-aeb6-8020d94c4e36', 'volume_name': 'volume-4d087802-9024-471f-aeb6-8020d94c4e36', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e90bd67-6442-498c-9b2a-7ac90ee7d16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e90bd67-6442-498c-9b2a-7ac90ee7d16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423a7d6f-8e4f-462b-9b47-c2ad74c6aa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Volume 4d087802-9024-471f-aeb6-8020d94c4e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d087802-9024-471f-aeb6-8020d94c4e36', 'volume_size': 1}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:55 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4
Nov 07 02:51:55 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:55 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.590s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948188057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800144a9-e1c0-4018-a478-0d7d70f03fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:54Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Creating volume 800144a9-e1c0-4018-a478-0d7d70f03fdc {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:55 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3fddca-1de8-4e1d-aa06-e0a1e59a1182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2726609-7cc5-4754-acb8-6d72249e91d4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack sudo[106539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc 1073741824
Nov 07 02:51:55 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65129369-ab54-48dc-aec0-3342e7c011a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Volume volume-f2726609-7cc5-4754-acb8-6d72249e91d4 (f2726609-7cc5-4754-acb8-6d72249e91d4): created successfully
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65129369-ab54-48dc-aec0-3342e7c011a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Flow 'volume_create_manager' (93eab230-1c91-4aa4-ab01-680f1de5c6df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4682a88b-f2f9-4fa9-b227-dcd611609222 tempest-CreateVolumesFromImageTest-214317079 None] Created volume successfully.
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (772df2cd-18ce-4b6b-94d4-79b8fd6da33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155e4491-aa64-43bb-9dab-9cdaca9e8e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155e4491-aa64-43bb-9dab-9cdaca9e8e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-940169385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44306b86-bf11-4a8d-935a-2dc2ded54711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:56Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621a4623-ca76-4a80-8588-446a3470eb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621a4623-ca76-4a80-8588-446a3470eb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170e9060-3bd6-4baa-ab25-4aa213620b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170e9060-3bd6-4baa-ab25-4aa213620b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44306b86-bf11-4a8d-935a-2dc2ded54711', 'volume_name': 'volume-44306b86-bf11-4a8d-935a-2dc2ded54711', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79914212-899a-406f-90ec-5d6271f68981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79914212-899a-406f-90ec-5d6271f68981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b790e8c-b79a-49de-b48e-ad0e9d105ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume 44306b86-bf11-4a8d-935a-2dc2ded54711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44306b86-bf11-4a8d-935a-2dc2ded54711', 'volume_size': 1}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (a2990c0b-9498-4742-8fe3-82b622357848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0706713e-c539-495c-b635-49060adc9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:56 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0706713e-c539-495c-b635-49060adc9c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979980017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8485da-5ce1-4f81-89f0-669738a001b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:56Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083cad28-a75d-485d-a97a-53fbb6a28dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083cad28-a75d-485d-a97a-53fbb6a28dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6e5612-1fca-4357-8dbf-40db68064335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6e5612-1fca-4357-8dbf-40db68064335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e8485da-5ce1-4f81-89f0-669738a001b6', 'volume_name': 'volume-6e8485da-5ce1-4f81-89f0-669738a001b6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7435a4d-2ce0-4890-87f5-e0495e57bcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7435a4d-2ce0-4890-87f5-e0495e57bcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bedf46-8dea-4cc7-a870-95dbf1cfa6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:56 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume 6e8485da-5ce1-4f81-89f0-669738a001b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e8485da-5ce1-4f81-89f0-669738a001b6', 'volume_size': 1}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc 1073741824" returned: 0 in 0.674s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:56 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc
Nov 07 02:51:56 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:56 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc" returned: 0 in 0.339s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.547s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-114500364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840897b7-1f0a-4016-b611-c8af27d5a062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b908474c9084399824d70e34c5f5a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:54Z,use_quota=True,user_id='2a42cbe6a09d426faa506eb4240eb986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Creating volume 840897b7-1f0a-4016-b611-c8af27d5a062 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:56 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8483724-8335-4a94-aaff-9e23da6822d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800144a9-e1c0-4018-a478-0d7d70f03fdc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8dd7cb-e2b0-4ecc-98c8-96d45b0521b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062 1073741824
Nov 07 02:51:57 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (a152dfc2-b15c-4c52-a71d-34b1ca98b3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b8cd26-e209-4987-a194-c4369e08fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume volume-800144a9-e1c0-4018-a478-0d7d70f03fdc (800144a9-e1c0-4018-a478-0d7d70f03fdc): created successfully
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8dd7cb-e2b0-4ecc-98c8-96d45b0521b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (564d9044-a01f-41a8-9cfa-44083a384769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b8cd26-e209-4987-a194-c4369e08fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1610894813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf77d84-e70f-4244-969f-b1220d4ff27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:57Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44407394-94d4-44ba-a915-6a2e8339cd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44407394-94d4-44ba-a915-6a2e8339cd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6905b12f-5df9-4689-96b7-d24acb4a7916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6905b12f-5df9-4689-96b7-d24acb4a7916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf77d84-e70f-4244-969f-b1220d4ff27e', 'volume_name': 'volume-4bf77d84-e70f-4244-969f-b1220d4ff27e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf31a923-7ad8-4f59-877a-e5aa8c1d6f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf31a923-7ad8-4f59-877a-e5aa8c1d6f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0752f796-a771-4edf-bac5-ec03fc21f510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume 4bf77d84-e70f-4244-969f-b1220d4ff27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf77d84-e70f-4244-969f-b1220d4ff27e', 'volume_size': 1}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a339db86-eb24-41e6-b76f-4076d7bfd444 tempest-CreateVolumesFromSnapshotTest-823391122 None] Created volume successfully.
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (0e47bf67-e2a0-483e-a5ca-ddb46cf79a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb5f567-52e7-49a6-a6e5-4395c36a54a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb5f567-52e7-49a6-a6e5-4395c36a54a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1060992655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f715d875-7db9-4bc4-9f61-c445cf39efd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:57Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740fcbf1-e91f-49d2-aaa5-f18b9e71034b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740fcbf1-e91f-49d2-aaa5-f18b9e71034b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bb805b-45e9-47e4-bd81-69e67f25a153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bb805b-45e9-47e4-bd81-69e67f25a153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f715d875-7db9-4bc4-9f61-c445cf39efd6', 'volume_name': 'volume-f715d875-7db9-4bc4-9f61-c445cf39efd6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b95d1b9-beef-4290-a325-82b03ff0218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b95d1b9-beef-4290-a325-82b03ff0218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b82e136-7b04-490f-93d5-8a2e134f3576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume f715d875-7db9-4bc4-9f61-c445cf39efd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f715d875-7db9-4bc4-9f61-c445cf39efd6', 'volume_size': 1}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:57 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062 1073741824" returned: 0 in 0.734s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:57 devstack sudo[106555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062
Nov 07 02:51:57 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (c4f42a9c-d711-4a1e-a720-dd476f747111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c2a048-cd5d-447f-ba67-c75ccbe78249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c2a048-cd5d-447f-ba67-c75ccbe78249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1282144199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520935fe-9d0e-4c6d-8007-f15f57c1cfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:58Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c368f151-1884-407b-85bb-c76ad64578ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c368f151-1884-407b-85bb-c76ad64578ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78100309-f936-48ba-b3c1-be9df7acce39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78100309-f936-48ba-b3c1-be9df7acce39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '520935fe-9d0e-4c6d-8007-f15f57c1cfda', 'volume_name': 'volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d156449-9100-427b-aa16-a94406b8a940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d156449-9100-427b-aa16-a94406b8a940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f277091-971c-45f1-93d6-60618990c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume 520935fe-9d0e-4c6d-8007-f15f57c1cfda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda', 'volume_size': 1}
Nov 07 02:51:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:58 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062" returned: 0 in 0.300s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.394s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2019492625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df21519-b619-4d26-b1bd-18495bd1ca9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b908474c9084399824d70e34c5f5a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:54Z,use_quota=True,user_id='2a42cbe6a09d426faa506eb4240eb986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Creating volume 6df21519-b619-4d26-b1bd-18495bd1ca9e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:58 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de6416d-cb84-4a02-a8c2-7c2ff1f39dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-840897b7-1f0a-4016-b611-c8af27d5a062', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d57063-54ee-4993-a251-f10ecf37dc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:58 devstack sudo[106558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e 1073741824
Nov 07 02:51:58 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Volume volume-840897b7-1f0a-4016-b611-c8af27d5a062 (840897b7-1f0a-4016-b611-c8af27d5a062): created successfully
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d57063-54ee-4993-a251-f10ecf37dc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Flow 'volume_create_manager' (6698cc53-69ed-4de4-abe7-4a219319a037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:58 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1bfa5b35-28ae-4533-b577-3a8194ffd368 tempest-CreateVolumesFromImageTest-214317079 None] Created volume successfully.
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Flow 'volume_create_manager' (07edf7a7-7a9a-40df-b90f-0939789ac277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e07135-4249-4d07-9149-1e610cd8ef57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e07135-4249-4d07-9149-1e610cd8ef57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33da350b-5eb2-4d31-8aff-c9b59e41c40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df918783d16e4e919c89a70c32c8dd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:58Z,use_quota=True,user_id='fdf0d9170466442d8243e0997d30d1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05484b8c-78d3-4c29-a54d-9c879d9ff5f6),volume_type_id=05484b8c-78d3-4c29-a54d-9c879d9ff5f6)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ecc087-3396-4c60-bb5a-efc965882060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ecc087-3396-4c60-bb5a-efc965882060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90db23fe-3334-4c18-8eee-3ddc5fba6782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:51:58 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e 1073741824" returned: 0 in 0.534s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:58 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e
Nov 07 02:51:58 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90db23fe-3334-4c18-8eee-3ddc5fba6782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33da350b-5eb2-4d31-8aff-c9b59e41c40d', 'volume_name': 'volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d', 'volume_size': 1, 'image_id': 'b8208dc4-148b-420b-99e7-f79b5e2370cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8208dc4-148b-420b-99e7-f79b5e2370cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd122241e29b9589e21b00b9127808101', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df918783d16e4e919c89a70c32c8dd21', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71d662855321878eb586e8c6e072f1e4a542236887a0cca73e725250385542720b22e6f6b44ef6d08806e9073e93992de93fd8a2ccfb499687a373278c4693fc', 'id': 'b8208dc4-148b-420b-99e7-f79b5e2370cd', 'created_at': datetime.datetime(2026, 11, 7, 1, 51, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 51, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8208dc4-148b-420b-99e7-f79b5e2370cd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb1dbc20>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f739fad1-f869-4259-85e7-577838c0f0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f739fad1-f869-4259-85e7-577838c0f0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8d3e1b-69c9-4e03-b568-8d54f42580ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:58 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Volume 33da350b-5eb2-4d31-8aff-c9b59e41c40d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d', 'volume_size': 1, 'image_id': 'b8208dc4-148b-420b-99e7-f79b5e2370cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8208dc4-148b-420b-99e7-f79b5e2370cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd122241e29b9589e21b00b9127808101', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df918783d16e4e919c89a70c32c8dd21', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71d662855321878eb586e8c6e072f1e4a542236887a0cca73e725250385542720b22e6f6b44ef6d08806e9073e93992de93fd8a2ccfb499687a373278c4693fc', 'id': 'b8208dc4-148b-420b-99e7-f79b5e2370cd', 'created_at': datetime.datetime(2026, 11, 7, 1, 51, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 51, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8208dc4-148b-420b-99e7-f79b5e2370cd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb1dbc20>}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Trying to clone 33da350b-5eb2-4d31-8aff-c9b59e41c40d from image b8208dc4-148b-420b-99e7-f79b5e2370cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8208dc4-148b-420b-99e7-f79b5e2370cd', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:51:58 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Image download 0.00 MB at 0.00 MB/s
Nov 07 02:51:58 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e" returned: 0 in 0.315s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.741s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-558278963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007d8c51-c9b0-4c7d-aad5-33feea48ba3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b908474c9084399824d70e34c5f5a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:55Z,use_quota=True,user_id='2a42cbe6a09d426faa506eb4240eb986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Creating volume 007d8c51-c9b0-4c7d-aad5-33feea48ba3e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:58 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:58 devstack sudo[106568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e 1073741824
Nov 07 02:51:58 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c5c727-5c01-4b91-a156-2013de31c94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df21519-b619-4d26-b1bd-18495bd1ca9e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:58 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afece1c-3167-4f5d-af16-4f8ed57dd2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2f1367-c5f9-4a1f-be99-ff4dd2dbe543]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Volume volume-6df21519-b619-4d26-b1bd-18495bd1ca9e (6df21519-b619-4d26-b1bd-18495bd1ca9e): created successfully
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afece1c-3167-4f5d-af16-4f8ed57dd2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Flow 'volume_create_manager' (7ec954ea-f0bf-453f-8ae2-fd78f65e5e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ba563d68-8ad7-4a17-a159-4fc95c5cfd16 tempest-CreateVolumesFromImageTest-214317079 None] Created volume successfully.
Nov 07 02:51:59 devstack sudo[106570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD
Nov 07 02:51:59 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:59 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:59 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e 1073741824" returned: 0 in 0.476s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:59 devstack sudo[106579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e
Nov 07 02:51:59 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:59 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD
Nov 07 02:51:59 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:59 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e" returned: 0 in 0.257s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.258s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-397184098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d087802-9024-471f-aeb6-8020d94c4e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b908474c9084399824d70e34c5f5a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:55Z,use_quota=True,user_id='2a42cbe6a09d426faa506eb4240eb986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Creating volume 4d087802-9024-471f-aeb6-8020d94c4e36 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:59 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:59 devstack sudo[106586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36 1073741824
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Temporary image b8208dc4-148b-420b-99e7-f79b5e2370cd is fetched for user fdf0d9170466442d8243e0997d30d1d1. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:51:59 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05618b9-893c-407b-ac9a-0c9bacce5bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f477fc8-25ba-4ecb-9081-b92e43774e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Volume volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e (007d8c51-c9b0-4c7d-aad5-33feea48ba3e): created successfully
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f477fc8-25ba-4ecb-9081-b92e43774e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Flow 'volume_create_manager' (aad51b4f-2262-4de0-a866-fdaae33ea4a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-94e1e8c3-ff36-44a7-b9cd-3f56bbb37ec8 tempest-CreateVolumesFromImageTest-214317079 None] Created volume successfully.
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4acd288-bcf4-4da3-80b6-feb1f6f826d1]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:00 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD
Nov 07 02:52:00 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:00 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36 1073741824" returned: 0 in 0.516s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:00 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:00 devstack sudo[106596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36
Nov 07 02:52:00 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:00 devstack sudo[106595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD
Nov 07 02:52:00 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:00 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36" returned: 0 in 0.284s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:00 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.472s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-940169385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44306b86-bf11-4a8d-935a-2dc2ded54711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:56Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Creating volume 44306b86-bf11-4a8d-935a-2dc2ded54711 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:00 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:00 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711 1073741824
Nov 07 02:52:00 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423a7d6f-8e4f-462b-9b47-c2ad74c6aa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d087802-9024-471f-aeb6-8020d94c4e36', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5696f755-3452-46d6-87a6-0cf7b871d0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:00 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Volume volume-4d087802-9024-471f-aeb6-8020d94c4e36 (4d087802-9024-471f-aeb6-8020d94c4e36): created successfully
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5696f755-3452-46d6-87a6-0cf7b871d0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Flow 'volume_create_manager' (0df36cdf-c442-4111-8aa1-a652d234d6f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9eb41b0b-9995-4673-93ae-36136675679f tempest-CreateVolumesFromImageTest-214317079 None] Created volume successfully.
Nov 07 02:52:01 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711 1073741824" returned: 0 in 0.449s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:01 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711
Nov 07 02:52:01 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "cinder-4d087802-9024-471f-aeb6-8020d94c4e36-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:01 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711" returned: 0 in 0.292s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.864s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979980017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8485da-5ce1-4f81-89f0-669738a001b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:56Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Creating volume 6e8485da-5ce1-4f81-89f0-669738a001b6 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:01 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b790e8c-b79a-49de-b48e-ad0e9d105ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44306b86-bf11-4a8d-935a-2dc2ded54711', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5586c9-2c0b-40eb-85f6-1313e883dbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:01 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6 1073741824
Nov 07 02:52:01 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-4d087802-9024-471f-aeb6-8020d94c4e36-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:01 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume volume-44306b86-bf11-4a8d-935a-2dc2ded54711 (44306b86-bf11-4a8d-935a-2dc2ded54711): created successfully
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5586c9-2c0b-40eb-85f6-1313e883dbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (772df2cd-18ce-4b6b-94d4-79b8fd6da33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7e65f7e5-087a-4a55-ba24-c3353b89a3b2 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created volume successfully.
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "cinder-quobyte-4d087802-9024-471f-aeb6-8020d94c4e36" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-quobyte-4d087802-9024-471f-aeb6-8020d94c4e36" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f94d8cc-0716-4313-ac1f-1f198d0b776e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:01 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36
Nov 07 02:52:01 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:01 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6 1073741824" returned: 0 in 0.456s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:01 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6
Nov 07 02:52:01 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:02 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36" returned: 0 in 0.438s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:02 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36
Nov 07 02:52:02 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:02 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6" returned: 0 in 0.286s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.048s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1610894813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf77d84-e70f-4244-969f-b1220d4ff27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:57Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Creating volume 4bf77d84-e70f-4244-969f-b1220d4ff27e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:02 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bedf46-8dea-4cc7-a870-95dbf1cfa6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8485da-5ce1-4f81-89f0-669738a001b6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:02 devstack sudo[106628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e 1073741824
Nov 07 02:52:02 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad23bd4a-bdb0-456f-b60c-eb92bae2fe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:02 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4d087802-9024-471f-aeb6-8020d94c4e36" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-quobyte-4d087802-9024-471f-aeb6-8020d94c4e36" released by "delete_volume" :: held 0.745s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:02 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume volume-6e8485da-5ce1-4f81-89f0-669738a001b6 (6e8485da-5ce1-4f81-89f0-669738a001b6): created successfully
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad23bd4a-bdb0-456f-b60c-eb92bae2fe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (a2990c0b-9498-4742-8fe3-82b622357848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-33c9ffa6-f130-4904-bce2-3c2fbb8632ac tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created volume successfully.
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Created reservations ['de8cec7d-6377-4e91-93f7-fc2ad67ee62e', '6c8b1aa8-1d51-45d1-9139-4888ab9f2aa7', 'fe798b59-abdc-4f41-b8ac-82780fdbe3e3', '1a7d193e-5c9d-4574-96c1-cd3cd95cb816'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:02 devstack sudo[106633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:02 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "cinder-007d8c51-c9b0-4c7d-aad5-33feea48ba3e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-007d8c51-c9b0-4c7d-aad5-33feea48ba3e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "cinder-quobyte-007d8c51-c9b0-4c7d-aad5-33feea48ba3e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-quobyte-007d8c51-c9b0-4c7d-aad5-33feea48ba3e" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5872c5a-4994-4788-9b8e-114dd6f64d09]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:02 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e 1073741824" returned: 0 in 0.601s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:02 devstack sudo[106636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e
Nov 07 02:52:02 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:02 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.342s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Deleted volume successfully.
Nov 07 02:52:02 devstack sudo[106639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e
Nov 07 02:52:02 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-694dad1c-5d93-419c-8de5-786e6cf11b60 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-4d087802-9024-471f-aeb6-8020d94c4e36-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:03 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e" returned: 0 in 0.267s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.589s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1060992655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f715d875-7db9-4bc4-9f61-c445cf39efd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:57Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Creating volume f715d875-7db9-4bc4-9f61-c445cf39efd6 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:03 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:03 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0752f796-a771-4edf-bac5-ec03fc21f510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf77d84-e70f-4244-969f-b1220d4ff27e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:03 devstack sudo[106645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6 1073741824
Nov 07 02:52:03 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac96265-6e67-4654-921e-422596e8e0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e" returned: 0 in 0.458s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:03 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume volume-4bf77d84-e70f-4244-969f-b1220d4ff27e (4bf77d84-e70f-4244-969f-b1220d4ff27e): created successfully
Nov 07 02:52:03 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e
Nov 07 02:52:03 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac96265-6e67-4654-921e-422596e8e0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (a152dfc2-b15c-4c52-a71d-34b1ca98b3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b41e1c8b-22e3-4322-aa83-257a22ccee82 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created volume successfully.
Nov 07 02:52:03 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-007d8c51-c9b0-4c7d-aad5-33feea48ba3e" returned: 0 in 0.254s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-quobyte-007d8c51-c9b0-4c7d-aad5-33feea48ba3e" released by "delete_volume" :: held 0.758s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Created reservations ['d2fea674-c060-43d9-b499-cbef609cc145', 'e7ee700f-37b2-470a-a1fe-fb676dfe5195', '9985fd21-38d1-4f0a-90c7-d03df7190004', '987d2e6f-bf62-49ab-b6b3-1181ce159f78'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:03 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6 1073741824" returned: 0 in 0.475s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:03 devstack sudo[106654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:03 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:03 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6
Nov 07 02:52:03 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "cinder-6df21519-b619-4d26-b1bd-18495bd1ca9e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-6df21519-b619-4d26-b1bd-18495bd1ca9e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "cinder-quobyte-6df21519-b619-4d26-b1bd-18495bd1ca9e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-quobyte-6df21519-b619-4d26-b1bd-18495bd1ca9e" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:03 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.303s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Deleted volume successfully.
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c05f53-629f-4111-8892-80321e040ba5]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-88f53d27-6394-480d-b793-672f0d203e5b tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-007d8c51-c9b0-4c7d-aad5-33feea48ba3e-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:03 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6" returned: 0 in 0.335s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.137s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1282144199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520935fe-9d0e-4c6d-8007-f15f57c1cfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341c53616885432facc9d96e827f53a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:58Z,use_quota=True,user_id='fd18140c18bb40888cb49d5a660e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Creating volume 520935fe-9d0e-4c6d-8007-f15f57c1cfda {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:04 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b82e136-7b04-490f-93d5-8a2e134f3576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f715d875-7db9-4bc4-9f61-c445cf39efd6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:04 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e
Nov 07 02:52:04 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc47ce62-6828-44f7-9a52-beda8e113eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:04 devstack sudo[106661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda 1073741824
Nov 07 02:52:04 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:04 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume volume-f715d875-7db9-4bc4-9f61-c445cf39efd6 (f715d875-7db9-4bc4-9f61-c445cf39efd6): created successfully
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc47ce62-6828-44f7-9a52-beda8e113eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (0e47bf67-e2a0-483e-a5ca-ddb46cf79a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2330186b-cfc1-45f4-b49f-d3b161687b1b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created volume successfully.
Nov 07 02:52:04 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e" returned: 0 in 0.403s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:04 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e
Nov 07 02:52:04 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:04 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda 1073741824" returned: 0 in 0.492s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:04 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda
Nov 07 02:52:04 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:04 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6df21519-b619-4d26-b1bd-18495bd1ca9e" returned: 0 in 0.311s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-quobyte-6df21519-b619-4d26-b1bd-18495bd1ca9e" released by "delete_volume" :: held 0.775s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Created reservations ['d883b534-d239-4495-9e0a-b94e46763dd7', 'a33605ae-46ed-4bab-93b1-8dccba308b6b', '15cf97ac-02e8-4017-a670-00943b3332a7', '66d1143e-a1db-44cd-affb-da2593367fb8'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:04 devstack sudo[106676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:04 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:04 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda" returned: 0 in 0.283s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.448s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] Creating offline snapshot 8233a8f1-9e7d-4fcf-a721-c412699a2e8e of volume 800144a9-e1c0-4018-a478-0d7d70f03fdc {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f277091-971c-45f1-93d6-60618990c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22480f21-2e93-4530-b412-5dfc5c28b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b97c4cc-9369-4ee3-a3fc-4726962e5633]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:04 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Volume volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda (520935fe-9d0e-4c6d-8007-f15f57c1cfda): created successfully
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22480f21-2e93-4530-b412-5dfc5c28b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Flow 'volume_create_manager' (c4f42a9c-d711-4a1e-a720-dd476f747111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-47add0fc-8d85-46f9-b973-b6e9fe828d6c tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created volume successfully.
Nov 07 02:52:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "cinder-840897b7-1f0a-4016-b611-c8af27d5a062-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-840897b7-1f0a-4016-b611-c8af27d5a062-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:05 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc
Nov 07 02:52:05 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "cinder-quobyte-840897b7-1f0a-4016-b611-c8af27d5a062" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-quobyte-840897b7-1f0a-4016-b611-c8af27d5a062" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:05 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.313s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:05 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Deleted volume successfully.
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[adddfe62-12a5-4401-8b13-af099905273f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-a021e557-5f71-492f-a883-1d1e80c4bd9f tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-6df21519-b619-4d26-b1bd-18495bd1ca9e-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:05 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062
Nov 07 02:52:05 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:05 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc" returned: 0 in 0.444s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:05 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e 1G
Nov 07 02:52:05 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:05 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:05 devstack sudo[106692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062
Nov 07 02:52:05 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-520935fe-9d0e-4c6d-8007-f15f57c1cfda-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:05 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e 1G" returned: 0 in 0.493s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800144a9-e1c0-4018-a478-0d7d70f03fdc -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:05 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-520935fe-9d0e-4c6d-8007-f15f57c1cfda-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:05 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800144a9-e1c0-4018-a478-0d7d70f03fdc -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e
Nov 07 02:52:05 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-840897b7-1f0a-4016-b611-c8af27d5a062" returned: 0 in 0.336s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-quobyte-840897b7-1f0a-4016-b611-c8af27d5a062" released by "delete_volume" :: held 0.792s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-quobyte-520935fe-9d0e-4c6d-8007-f15f57c1cfda" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-520935fe-9d0e-4c6d-8007-f15f57c1cfda" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2c6cd1-c297-4bf9-95cd-64d1cd16b7c7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:05 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Created reservations ['68f9fd9b-80e7-4c83-92f5-dd8a4da9213c', 'faf4c499-8137-4a5b-ad61-2e9a33a1b7b2', '4c28f805-4217-43c8-a13e-02ebb1de6132', 'd9f850a0-b4d8-4869-ae2f-74cfa83e4f35'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:06 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda
Nov 07 02:52:06 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:06 devstack sudo[106703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:06 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:06 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "cinder-f2726609-7cc5-4754-acb8-6d72249e91d4-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800144a9-e1c0-4018-a478-0d7d70f03fdc -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e" returned: 0 in 0.411s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:06 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e is being set with open permissions: ugo+rw
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-f2726609-7cc5-4754-acb8-6d72249e91d4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:06 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e
Nov 07 02:52:06 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "cinder-quobyte-f2726609-7cc5-4754-acb8-6d72249e91d4" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-quobyte-f2726609-7cc5-4754-acb8-6d72249e91d4" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedfb909-890a-4d5d-9ea9-1752e3d67aa0]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:06 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.372s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Deleted volume successfully.
Nov 07 02:52:06 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda" returned: 0 in 0.538s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-680653f3-399e-43dd-aacd-a60bf77b3bc7 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-840897b7-1f0a-4016-b611-c8af27d5a062-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:06 devstack sudo[106709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4
Nov 07 02:52:06 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:06 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda
Nov 07 02:52:06 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:06 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e" returned: 0 in 0.332s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:06 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.info
Nov 07 02:52:06 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:06 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-520935fe-9d0e-4c6d-8007-f15f57c1cfda" returned: 0 in 0.289s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-520935fe-9d0e-4c6d-8007-f15f57c1cfda" released by "delete_volume" :: held 0.883s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:06 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4" returned: 0 in 0.458s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:06 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4
Nov 07 02:52:06 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created reservations ['6e203585-d93b-483d-959b-53accd05fc9f', 'f7c3a5a0-b4c0-4f58-9d60-3704600d63e6', 'ec602ee7-7912-4e07-ad6d-8f7be6bc066e', '4f6a57c6-e1ac-4f43-8e90-81cb64866abc'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:06 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.info" returned: 0 in 0.313s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:06 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.info is being set with open permissions: ugo+rw
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:06 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.info
Nov 07 02:52:06 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:07 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:07 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:07 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f2726609-7cc5-4754-acb8-6d72249e91d4" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-quobyte-f2726609-7cc5-4754-acb8-6d72249e91d4" released by "delete_volume" :: held 0.804s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Created reservations ['847765ca-2e06-4231-bac6-5bebc8976227', 'f10cdba5-cfc0-40d4-a64b-6ea9aef9f69b', 'cfa01d1e-094f-4ef9-85d9-6a17dac9be0c', '1d691038-126b-42db-bc82-3acb54dd1083'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:07 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.info" returned: 0 in 0.276s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.592s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33da350b-5eb2-4d31-8aff-c9b59e41c40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df918783d16e4e919c89a70c32c8dd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:58Z,use_quota=True,user_id='fdf0d9170466442d8243e0997d30d1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05484b8c-78d3-4c29-a54d-9c879d9ff5f6),volume_type_id=05484b8c-78d3-4c29-a54d-9c879d9ff5f6)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Creating volume 33da350b-5eb2-4d31-8aff-c9b59e41c40d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:07 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:07 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d 1073741824
Nov 07 02:52:07 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9ae48956-ad27-4de4-95ef-7a3900222bbf tempest-CreateVolumesFromSnapshotTest-823391122 None] Create snapshot completed successfully
Nov 07 02:52:07 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.288s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Deleted volume successfully.
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-63916632-9f54-4dd5-b2bd-bd8b13d3960b tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-520935fe-9d0e-4c6d-8007-f15f57c1cfda-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:07 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:07 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:07 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.273s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Deleted volume successfully.
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-95cb472b-b92d-4976-a87b-a0f18c4f3822 tempest-CreateVolumesFromImageTest-214317079 None] Lock "cinder-f2726609-7cc5-4754-acb8-6d72249e91d4-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:07 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d 1073741824" returned: 0 in 0.539s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:07 devstack sudo[106742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d
Nov 07 02:52:07 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-f715d875-7db9-4bc4-9f61-c445cf39efd6-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-f715d875-7db9-4bc4-9f61-c445cf39efd6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-quobyte-f715d875-7db9-4bc4-9f61-c445cf39efd6" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:08 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-f715d875-7db9-4bc4-9f61-c445cf39efd6" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Attempting download of b8208dc4-148b-420b-99e7-f79b5e2370cd ((None, [{'url': 'file:///opt/stack/data/glance/images/b8208dc4-148b-420b-99e7-f79b5e2370cd', 'metadata': {}}])) to volume 33da350b-5eb2-4d31-8aff-c9b59e41c40d. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[553f202b-0128-4cb8-9e82-a2c85adba2a0]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[41650320-4a16-4d4f-9fbd-91489398cf93]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8208dc4-148b-420b-99e7-f79b5e2370cd_tu138257 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:08 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6
Nov 07 02:52:08 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (71699699-88d8-4926-b2ca-d1330ae1af59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:08 devstack sudo[106747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8208dc4-148b-420b-99e7-f79b5e2370cd_tu138257
Nov 07 02:52:08 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe3870e-96eb-4f93-a485-421f6b87d3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe3870e-96eb-4f93-a485-421f6b87d3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1082574882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e529450-f653-4147-a60a-aea018d5af6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:08Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1026405-7766-4398-ba4e-4fea8b822a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1026405-7766-4398-ba4e-4fea8b822a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571a9453-b133-420d-8cd8-bd691ebf30dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571a9453-b133-420d-8cd8-bd691ebf30dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e529450-f653-4147-a60a-aea018d5af6f', 'volume_name': 'volume-4e529450-f653-4147-a60a-aea018d5af6f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9245a7d-0718-40ba-a275-8554d6f7ce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9245a7d-0718-40ba-a275-8554d6f7ce30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4ef8bc-de3e-4e2b-9ff3-132808eb0e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:08 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume 4e529450-f653-4147-a60a-aea018d5af6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e529450-f653-4147-a60a-aea018d5af6f', 'volume_size': 1}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1082574882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e529450-f653-4147-a60a-aea018d5af6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:08Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Creating volume 4e529450-f653-4147-a60a-aea018d5af6f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:08 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:08 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f 1073741824
Nov 07 02:52:08 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:08 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6" returned: 0 in 0.627s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:08 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6
Nov 07 02:52:08 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:08 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8208dc4-148b-420b-99e7-f79b5e2370cd_tu138257" returned: 0 in 0.624s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8208dc4-148b-420b-99e7-f79b5e2370cd_tu138257 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (e3c6a261-fcf5-4d8a-8cc1-3df8197a7b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed65582c-7bcc-428f-a6b9-f0f7f70d151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:09 devstack sudo[106760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8208dc4-148b-420b-99e7-f79b5e2370cd_tu138257
Nov 07 02:52:09 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed65582c-7bcc-428f-a6b9-f0f7f70d151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-146271757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:09Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377db4f6-25f9-49bd-9dcb-d05a5c04586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377db4f6-25f9-49bd-9dcb-d05a5c04586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eb0b98-c7d8-44db-a897-a0edd52187a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eb0b98-c7d8-44db-a897-a0edd52187a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102', 'volume_name': 'volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8f0619-a121-4b65-a0f7-2dde60154a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8f0619-a121-4b65-a0f7-2dde60154a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b027d5-adbc-4154-922d-2c7c7fa7d1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:09 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102', 'volume_size': 1}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:09 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-f715d875-7db9-4bc4-9f61-c445cf39efd6" returned: 0 in 0.517s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:09 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f 1073741824" returned: 0 in 0.771s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-f715d875-7db9-4bc4-9f61-c445cf39efd6" released by "delete_volume" :: held 1.228s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:09 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f
Nov 07 02:52:09 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:09 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8208dc4-148b-420b-99e7-f79b5e2370cd_tu138257" returned: 1 in 0.598s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8208dc4-148b-420b-99e7-f79b5e2370cd_tu138257' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60f6d13-23a9-4535-8d55-da5046149d8b]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created reservations ['b4a758bb-7286-4e3e-9a9a-18d88beea6b3', 'cbb60b7e-9135-4b5d-9fa4-cef0a929b0ca', 'd240b6b3-2624-4e69-ab6b-e1e8e6209dfb', 'd5435bb6-5a22-4e5f-9cb9-5ccc23a74edc'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:09 devstack sudo[106770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD
Nov 07 02:52:09 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (338c2003-5392-48a0-9804-e56cedc6e41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9709cbe3-aec8-48be-93a0-171d620ae159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:09 devstack sudo[106773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:09 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9709cbe3-aec8-48be-93a0-171d620ae159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-348111258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274e1aff-6c08-4ad2-b2d4-13db2a640e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:10Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcde1b2-a63e-4de9-b3f4-23e3bd3fae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcde1b2-a63e-4de9-b3f4-23e3bd3fae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:09 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6773c5de-8ef7-4f6a-9d27-5c8ec94b80c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6773c5de-8ef7-4f6a-9d27-5c8ec94b80c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '274e1aff-6c08-4ad2-b2d4-13db2a640e47', 'volume_name': 'volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f52847-63df-4c91-9dd2-a987a48b0b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:09 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f52847-63df-4c91-9dd2-a987a48b0b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e03d0b2-6273-40eb-ae55-bee89272f5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:10 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume 274e1aff-6c08-4ad2-b2d4-13db2a640e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47', 'volume_size': 1}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f" returned: 0 in 0.513s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-146271757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:09Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Creating volume a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:10 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:10 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:10 devstack sudo[106777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102 1073741824
Nov 07 02:52:10 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4ef8bc-de3e-4e2b-9ff3-132808eb0e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e529450-f653-4147-a60a-aea018d5af6f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3015e9fc-d3cd-479a-8e8d-9d644039bce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:10 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume volume-4e529450-f653-4147-a60a-aea018d5af6f (4e529450-f653-4147-a60a-aea018d5af6f): created successfully
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3015e9fc-d3cd-479a-8e8d-9d644039bce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (71699699-88d8-4926-b2ca-d1330ae1af59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-78f2329b-56e7-426f-a781-bd73b73f96eb tempest-CreateVolumesFromSnapshotTest-823391122 None] Created volume successfully.
Nov 07 02:52:10 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.412s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:10 devstack sudo[106778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD
Nov 07 02:52:10 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Deleted volume successfully.
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d4b1b42b-67a5-4af7-8668-d392419e3529 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-f715d875-7db9-4bc4-9f61-c445cf39efd6-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-4bf77d84-e70f-4244-969f-b1220d4ff27e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-4bf77d84-e70f-4244-969f-b1220d4ff27e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-quobyte-4bf77d84-e70f-4244-969f-b1220d4ff27e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-4bf77d84-e70f-4244-969f-b1220d4ff27e" acquired by "delete_volume" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:10 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (0b6589d7-34c3-4cda-864f-bf505fb3cb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873b00dc-6a5e-4499-aa53-db5b90b24b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0218275-2d7b-4a07-ad3e-2c50f4728c88]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD" returned: 1 in 0.630s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] b8208dc4-148b-420b-99e7-f79b5e2370cd was raw, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:10 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873b00dc-6a5e-4499-aa53-db5b90b24b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1736521673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced563d8-255f-4614-a2c3-d6e72985d76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:11Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:10 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555ce971-23c3-4f95-881a-59547ccf7866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555ce971-23c3-4f95-881a-59547ccf7866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdfd17a1-2930-4fb3-a733-2a3be908e1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdfd17a1-2930-4fb3-a733-2a3be908e1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced563d8-255f-4614-a2c3-d6e72985d76c', 'volume_name': 'volume-ced563d8-255f-4614-a2c3-d6e72985d76c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bd7686-c157-495c-86c1-bab339c9b2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bd7686-c157-495c-86c1-bab339c9b2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:10 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a920114-466a-4088-aef3-33ff3bdfa898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:10 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume ced563d8-255f-4614-a2c3-d6e72985d76c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced563d8-255f-4614-a2c3-d6e72985d76c', 'volume_size': 1}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102 1073741824" returned: 0 in 0.793s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:10 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e
Nov 07 02:52:10 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:10 devstack sudo[106793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102
Nov 07 02:52:10 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:11 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (7e8b445d-51c3-455c-9bea-fdc20e4aca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49a9f33-0f7c-4973-b877-dc779a17c0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102" returned: 0 in 0.473s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-348111258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274e1aff-6c08-4ad2-b2d4-13db2a640e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:10Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Creating volume 274e1aff-6c08-4ad2-b2d4-13db2a640e47 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:11 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:11 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47 1073741824
Nov 07 02:52:11 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49a9f33-0f7c-4973-b877-dc779a17c0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672739947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb9073b-af95-4680-84b5-7dad59189528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:11Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee31c12-2fad-4ca1-b36b-6e0f7b64f1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee31c12-2fad-4ca1-b36b-6e0f7b64f1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e9761a-c815-4d3e-995a-2314e91942ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e9761a-c815-4d3e-995a-2314e91942ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb9073b-af95-4680-84b5-7dad59189528', 'volume_name': 'volume-acb9073b-af95-4680-84b5-7dad59189528', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c070dc-5fbd-4b93-a7d0-5b6f4523fb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:11 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c070dc-5fbd-4b93-a7d0-5b6f4523fb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e100da6b-fe8c-4e16-9a09-8785c3e24c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume acb9073b-af95-4680-84b5-7dad59189528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb9073b-af95-4680-84b5-7dad59189528', 'volume_size': 1}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b027d5-adbc-4154-922d-2c7c7fa7d1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6485d5-f076-410f-9392-8107372abd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:11 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d" returned: 0 in 0.815s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b8208dc4-148b-420b-99e7-f79b5e2370cd_gc5t791edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:52:11 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Converted 0.00 MB image at 0.00 MB/s
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e" returned: 0 in 0.853s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:11 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d 1G
Nov 07 02:52:11 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102 (a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102): created successfully
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6485d5-f076-410f-9392-8107372abd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (e3c6a261-fcf5-4d8a-8cc1-3df8197a7b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:11 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e
Nov 07 02:52:11 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f422f1ae-e6d0-4d12-b52a-e90294c5bfce tempest-CreateVolumesFromSnapshotTest-823391122 None] Created volume successfully.
Nov 07 02:52:11 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4bf77d84-e70f-4244-969f-b1220d4ff27e" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-4bf77d84-e70f-4244-969f-b1220d4ff27e" released by "delete_volume" :: held 1.309s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:12 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created reservations ['252aa21f-acfd-499d-940f-745c1c076da0', '24db507b-2a6f-451d-a9ba-30b4fe9eca7a', '0887b83a-5597-4a70-986d-17c06e2ece03', 'b28c5fbb-d35f-4c65-b220-0f3c43d9724c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47 1073741824" returned: 0 in 0.632s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:12 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47
Nov 07 02:52:12 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:12 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d 1G" returned: 0 in 0.593s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Downloaded image b8208dc4-148b-420b-99e7-f79b5e2370cd ((None, [{'url': 'file:///opt/stack/data/glance/images/b8208dc4-148b-420b-99e7-f79b5e2370cd', 'metadata': {}}])) to volume 33da350b-5eb2-4d31-8aff-c9b59e41c40d successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Temporary image b8208dc4-148b-420b-99e7-f79b5e2370cd for user fdf0d9170466442d8243e0997d30d1d1 is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Marking volume 33da350b-5eb2-4d31-8aff-c9b59e41c40d as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Copying metadata from image b8208dc4-148b-420b-99e7-f79b5e2370cd to 33da350b-5eb2-4d31-8aff-c9b59e41c40d. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Creating volume glance metadata for volume 33da350b-5eb2-4d31-8aff-c9b59e41c40d backed by image b8208dc4-148b-420b-99e7-f79b5e2370cd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b8208dc4-148b-420b-99e7-f79b5e2370cd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd122241e29b9589e21b00b9127808101', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:12 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:12 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Flow 'volume_create_manager' (8e1a0836-a152-4321-ba99-d7c8c41a74be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878cdfe0-1d26-4af9-a7a1-4b276ca088ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:12 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878cdfe0-1d26-4af9-a7a1-4b276ca088ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce55b5d2-43aa-4e73-a464-5b42170f3ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae08c3e8f44a4ff1a522611eb90761d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:12Z,use_quota=True,user_id='5e7404803a95410095058f6978f041ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4211b8-9b81-4096-8b8c-5cf35bec61da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4211b8-9b81-4096-8b8c-5cf35bec61da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673a0457-53cb-4653-970a-1ca6a5f2ac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673a0457-53cb-4653-970a-1ca6a5f2ac8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce55b5d2-43aa-4e73-a464-5b42170f3ad5', 'volume_name': 'volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64fad61-88a1-472c-895d-f463dd3cee95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64fad61-88a1-472c-895d-f463dd3cee95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9da754-3af2-47a4-8856-b70d5a66ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Volume ce55b5d2-43aa-4e73-a464-5b42170f3ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5', 'volume_size': 1}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47" returned: 0 in 0.316s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.555s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1736521673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced563d8-255f-4614-a2c3-d6e72985d76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:11Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Creating volume ced563d8-255f-4614-a2c3-d6e72985d76c {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:12 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e03d0b2-6273-40eb-ae55-bee89272f5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec11a5a2-cd77-4f76-aace-f6d332287317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:12 devstack sudo[106825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c 1073741824
Nov 07 02:52:12 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8d3e1b-69c9-4e03-b568-8d54f42580ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d', 'volume_size': 1, 'image_id': 'b8208dc4-148b-420b-99e7-f79b5e2370cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8208dc4-148b-420b-99e7-f79b5e2370cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd122241e29b9589e21b00b9127808101', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df918783d16e4e919c89a70c32c8dd21', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71d662855321878eb586e8c6e072f1e4a542236887a0cca73e725250385542720b22e6f6b44ef6d08806e9073e93992de93fd8a2ccfb499687a373278c4693fc', 'id': 'b8208dc4-148b-420b-99e7-f79b5e2370cd', 'created_at': datetime.datetime(2026, 11, 7, 1, 51, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 51, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8208dc4-148b-420b-99e7-f79b5e2370cd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696fb1dbc20>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2564175-a079-43cd-80ae-3e4219c9a470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47 (274e1aff-6c08-4ad2-b2d4-13db2a640e47): created successfully
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec11a5a2-cd77-4f76-aace-f6d332287317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (338c2003-5392-48a0-9804-e56cedc6e41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a9b87288-2805-4cfe-bdf1-5670df114b3b tempest-CreateVolumesFromSnapshotTest-823391122 None] Created volume successfully.
Nov 07 02:52:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Volume volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d (33da350b-5eb2-4d31-8aff-c9b59e41c40d): created successfully
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2564175-a079-43cd-80ae-3e4219c9a470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:12 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Flow 'volume_create_manager' (07edf7a7-7a9a-40df-b90f-0939789ac277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.312s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Deleted volume successfully.
Nov 07 02:52:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-27b7ee7c-4eaf-4faa-8551-5d70e888a38d tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Created volume successfully.
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-92e41747-48b2-4bf6-a34b-68692d0e54e7 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-4bf77d84-e70f-4244-969f-b1220d4ff27e-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-6e8485da-5ce1-4f81-89f0-669738a001b6-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-6e8485da-5ce1-4f81-89f0-669738a001b6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:12 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-quobyte-6e8485da-5ce1-4f81-89f0-669738a001b6" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c 1073741824" returned: 0 in 0.481s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-6e8485da-5ce1-4f81-89f0-669738a001b6" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[987fa474-d41e-44de-99f8-ea3fd3ad140c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:12 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c
Nov 07 02:52:12 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:13 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6
Nov 07 02:52:13 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:13 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c" returned: 0 in 0.258s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.673s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672739947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb9073b-af95-4680-84b5-7dad59189528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6514d9e1f03b4803b8939ccb54db9ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:11Z,use_quota=True,user_id='23050867b1fb402e9d3bae5e4190a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Creating volume acb9073b-af95-4680-84b5-7dad59189528 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:13 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a920114-466a-4088-aef3-33ff3bdfa898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced563d8-255f-4614-a2c3-d6e72985d76c', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1911006-5c9d-4760-a829-8f64ca03cca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:13 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528 1073741824
Nov 07 02:52:13 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume volume-ced563d8-255f-4614-a2c3-d6e72985d76c (ced563d8-255f-4614-a2c3-d6e72985d76c): created successfully
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1911006-5c9d-4760-a829-8f64ca03cca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (0b6589d7-34c3-4cda-864f-bf505fb3cb03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8556b888-58c2-4c0d-bbd8-ac660867c192 tempest-CreateVolumesFromSnapshotTest-823391122 None] Created volume successfully.
Nov 07 02:52:13 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:13 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6
Nov 07 02:52:13 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:13 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6e8485da-5ce1-4f81-89f0-669738a001b6" returned: 0 in 0.266s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Acquiring lock "cinder-33da350b-5eb2-4d31-8aff-c9b59e41c40d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-6e8485da-5ce1-4f81-89f0-669738a001b6" released by "delete_volume" :: held 0.725s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Lock "cinder-33da350b-5eb2-4d31-8aff-c9b59e41c40d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:13 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528 1073741824" returned: 0 in 0.486s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Acquiring lock "cinder-quobyte-33da350b-5eb2-4d31-8aff-c9b59e41c40d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created reservations ['272e4ff0-68dc-4af8-91ae-576b07ebe9ea', '899b2d3b-6144-4991-9d45-eb5b4bcddfe4', '186ea8b6-af2b-4008-9470-19ec30d73343', '10b7332a-9c23-44ae-a31b-d2224594e75d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Lock "cinder-quobyte-33da350b-5eb2-4d31-8aff-c9b59e41c40d" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4a0e98-9dd1-4816-9e67-65f6a1f6cade]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:13 devstack sudo[106850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528
Nov 07 02:52:13 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:13 devstack sudo[106853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:13 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:13 devstack sudo[106851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d
Nov 07 02:52:13 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-44306b86-bf11-4a8d-935a-2dc2ded54711-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:14 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528" returned: 0 in 0.298s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-44306b86-bf11-4a8d-935a-2dc2ded54711-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce55b5d2-43aa-4e73-a464-5b42170f3ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae08c3e8f44a4ff1a522611eb90761d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:12Z,use_quota=True,user_id='5e7404803a95410095058f6978f041ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Creating volume ce55b5d2-43aa-4e73-a464-5b42170f3ad5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:14 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:14 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:14 devstack sudo[106858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5 1073741824
Nov 07 02:52:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Deleted volume successfully.
Nov 07 02:52:14 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e100da6b-fe8c-4e16-9a09-8785c3e24c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb9073b-af95-4680-84b5-7dad59189528', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae65724b-88ab-4787-96f6-e092d8e469aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:14 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Volume volume-acb9073b-af95-4680-84b5-7dad59189528 (acb9073b-af95-4680-84b5-7dad59189528): created successfully
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae65724b-88ab-4787-96f6-e092d8e469aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Flow 'volume_create_manager' (7e8b445d-51c3-455c-9bea-fdc20e4aca06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-96ed8522-901a-4bc9-9a4c-ae32c98ce2ee tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-6e8485da-5ce1-4f81-89f0-669738a001b6-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-quobyte-44306b86-bf11-4a8d-935a-2dc2ded54711" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:14 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a61cf961-75c2-4960-bcc9-7776909fab6d tempest-CreateVolumesFromSnapshotTest-823391122 None] Created volume successfully.
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-44306b86-bf11-4a8d-935a-2dc2ded54711" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24aa3c1-4b43-41dc-9fdf-d217f2ffcfaf]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:14 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d" returned: 0 in 0.502s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:14 devstack sudo[106864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d
Nov 07 02:52:14 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:14 devstack sudo[106863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711
Nov 07 02:52:14 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:14 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-33da350b-5eb2-4d31-8aff-c9b59e41c40d" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:14 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Lock "cinder-quobyte-33da350b-5eb2-4d31-8aff-c9b59e41c40d" released by "delete_volume" :: held 0.873s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5 1073741824" returned: 0 in 0.510s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:14 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-acb9073b-af95-4680-84b5-7dad59189528-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711" returned: 0 in 0.429s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:14 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5
Nov 07 02:52:14 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Created reservations ['b9ae3e14-5415-478d-84ac-b50d6b2981ee', '674798ec-e86e-4f73-ba91-aa216ba38a5a', 'ede19182-1d32-4aa3-bd79-12e70b91a046', '11cfc0e3-5547-4b32-9659-bb50afe3c61e'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:14 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711
Nov 07 02:52:14 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-acb9073b-af95-4680-84b5-7dad59189528-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-quobyte-acb9073b-af95-4680-84b5-7dad59189528" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-acb9073b-af95-4680-84b5-7dad59189528" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9b8015-68d8-4be9-9870-6d6f343b363d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:14 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:14 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:14 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5" returned: 0 in 0.319s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9da754-3af2-47a4-8856-b70d5a66ede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3289b220-72ea-43d9-922f-e1deb64d6574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:14 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-44306b86-bf11-4a8d-935a-2dc2ded54711" returned: 0 in 0.308s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:15 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Volume volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5 (ce55b5d2-43aa-4e73-a464-5b42170f3ad5): created successfully
Nov 07 02:52:15 devstack sudo[106881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528
Nov 07 02:52:15 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3289b220-72ea-43d9-922f-e1deb64d6574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Flow 'volume_create_manager' (8e1a0836-a152-4321-ba99-d7c8c41a74be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-44306b86-bf11-4a8d-935a-2dc2ded54711" released by "delete_volume" :: held 0.805s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-f5a944bb-5eaf-4d59-ba77-1920f0bb9484 tempest-CinderUnicodeTest-709858185 None] Created volume successfully.
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created reservations ['f15c477f-85c2-47da-b88a-8cf385a22d27', 'b5b3ad1d-4a11-4717-b39b-ef2f196f0845', '8d2871a7-a780-45e4-b076-84e95f063c43', '4a48dd5b-7e4b-4d06-9d51-fe4034284329'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:15 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.316s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Deleted volume successfully.
Nov 07 02:52:15 devstack sudo[106889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:15 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fe0efc46-c7db-4655-a37e-5d1ac75556cd tempest-VolumeAndVolumeTypeFromImageTest-1913341707 None] Lock "cinder-33da350b-5eb2-4d31-8aff-c9b59e41c40d-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:15 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528" returned: 0 in 0.401s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:15 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528
Nov 07 02:52:15 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:15 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.279s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Deleted volume successfully.
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8d7d379a-3e65-48ae-85a5-c6b6d0e70377 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-44306b86-bf11-4a8d-935a-2dc2ded54711-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:15 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-acb9073b-af95-4680-84b5-7dad59189528" returned: 0 in 0.280s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-acb9073b-af95-4680-84b5-7dad59189528" released by "delete_volume" :: held 0.752s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Created reservations ['37dddd74-23e7-4238-a08e-a156309a3ea0', 'fe84cf8f-2f76-486a-ad91-8ea16ca7ac4c', 'cd3624b2-6598-4d9f-af14-ebf97b5b8ab1', 'a3b7b18d-8baa-4bd6-8e5e-537a038dc703'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:15 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:15 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-ced563d8-255f-4614-a2c3-d6e72985d76c-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-ced563d8-255f-4614-a2c3-d6e72985d76c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-quobyte-ced563d8-255f-4614-a2c3-d6e72985d76c" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Flow 'volume_create_manager' (89dd0c04-49a7-47bf-9f76-5983224fcfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b176e63e-9e30-49e8-bced-3e5f0ba387a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-ced563d8-255f-4614-a2c3-d6e72985d76c" acquired by "delete_volume" :: waited 0.053s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b176e63e-9e30-49e8-bced-3e5f0ba387a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-5654072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e15d7829-e876-4d1d-985f-7862069b43b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae08c3e8f44a4ff1a522611eb90761d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:16Z,use_quota=True,user_id='5e7404803a95410095058f6978f041ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:16 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9a30e2-9c00-476b-9c7c-ceb9613f1198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9a30e2-9c00-476b-9c7c-ceb9613f1198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e754c8-ecf4-4c55-b4eb-074a836255a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e754c8-ecf4-4c55-b4eb-074a836255a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e15d7829-e876-4d1d-985f-7862069b43b5', 'volume_name': 'volume-e15d7829-e876-4d1d-985f-7862069b43b5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdf10a0-3917-4b0f-bdc7-eec0db0d5bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdf10a0-3917-4b0f-bdc7-eec0db0d5bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574e347a-e8f7-4b66-a891-c7eb9733c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Volume e15d7829-e876-4d1d-985f-7862069b43b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e15d7829-e876-4d1d-985f-7862069b43b5', 'volume_size': 1}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-5654072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e15d7829-e876-4d1d-985f-7862069b43b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae08c3e8f44a4ff1a522611eb90761d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:16Z,use_quota=True,user_id='5e7404803a95410095058f6978f041ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Creating volume e15d7829-e876-4d1d-985f-7862069b43b5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:16 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f25597-86c1-48a6-aa93-5c611130eac3]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.463s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:16 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5 1073741824
Nov 07 02:52:16 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Deleted volume successfully.
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-25c40e2a-b521-4a16-8887-2173f6209251 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-acb9073b-af95-4680-84b5-7dad59189528-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:16 devstack sudo[106900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c
Nov 07 02:52:16 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "cinder-quobyte-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c284e399-8239-4ef2-8c39-a4f0695e457b]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:16 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af
Nov 07 02:52:16 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:16 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c" returned: 0 in 0.540s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:16 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c
Nov 07 02:52:16 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:16 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5 1073741824" returned: 0 in 0.598s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:16 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5
Nov 07 02:52:16 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:16 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af" returned: 0 in 0.463s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:16 devstack sudo[106918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af
Nov 07 02:52:16 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:17 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ced563d8-255f-4614-a2c3-d6e72985d76c" returned: 0 in 0.371s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-ced563d8-255f-4614-a2c3-d6e72985d76c" released by "delete_volume" :: held 1.032s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:17 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574e347a-e8f7-4b66-a891-c7eb9733c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e15d7829-e876-4d1d-985f-7862069b43b5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6450b71-6926-4d3e-bbbe-464717c5933e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:17 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Volume volume-e15d7829-e876-4d1d-985f-7862069b43b5 (e15d7829-e876-4d1d-985f-7862069b43b5): created successfully
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6450b71-6926-4d3e-bbbe-464717c5933e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Flow 'volume_create_manager' (89dd0c04-49a7-47bf-9f76-5983224fcfdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Created reservations ['ebffce66-5554-4dab-8621-6bd1922c30e3', '8dd85452-e7e5-4c95-b57e-53f70584cbb5', '62e1090a-1ab5-4ebc-bb9e-6653f4a3d866', '7531cec6-4581-48e8-8959-0c4053ab7c6d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3db51bef-37df-4153-9427-e2f02c5403fd tempest-CinderUnicodeTest-709858185 None] Created volume successfully.
Nov 07 02:52:17 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-quobyte-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af" released by "delete_volume" :: held 0.843s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:17 devstack sudo[106923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:17 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Created reservations ['8b449e17-16e2-433c-a7db-59e881eb1889', '5910439b-bb58-431b-aec7-e429fec92642', 'b13ac1b5-f064-4cd8-ad4e-c4121ec7cb96', 'd690ec36-0df7-47e2-99e8-ee12e880d3cd'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:17 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:17 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:17 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.348s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Deleted volume successfully.
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-d11a6940-a908-4561-9b23-4331556c4c0d tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-ced563d8-255f-4614-a2c3-d6e72985d76c-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:17 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.347s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Deleted volume successfully.
Nov 07 02:52:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-9b57dbdb-ea4a-495f-9a73-b54ebd1579c4 tempest-CreateVolumesFromSourceVolumeTest-1931488455 None] Lock "cinder-fda3c2a2-a3cf-4bb2-8ca4-09012dfe96af-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-274e1aff-6c08-4ad2-b2d4-13db2a640e47-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-274e1aff-6c08-4ad2-b2d4-13db2a640e47-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-quobyte-274e1aff-6c08-4ad2-b2d4-13db2a640e47" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-274e1aff-6c08-4ad2-b2d4-13db2a640e47" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c489b74-25dc-45fd-8e38-39b514348ce1]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] Creating offline snapshot 64de4bff-7392-4c42-9e18-c1ab0fde9505 of volume e15d7829-e876-4d1d-985f-7862069b43b5 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b439c6f9-f386-4444-ad1b-ee8c9e65d5d7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:18 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47
Nov 07 02:52:18 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:18 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5
Nov 07 02:52:18 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:18 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47" returned: 0 in 0.473s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:18 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47
Nov 07 02:52:18 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:19 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5" returned: 0 in 0.538s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:19 devstack sudo[106942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505 1G
Nov 07 02:52:19 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:19 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-274e1aff-6c08-4ad2-b2d4-13db2a640e47" returned: 0 in 0.356s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-274e1aff-6c08-4ad2-b2d4-13db2a640e47" released by "delete_volume" :: held 0.917s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Created reservations ['eace71b6-2e6d-42a5-90f5-99a5661207d8', 'f728628d-cb73-468f-a2b1-d3023b009ec2', 'fb775a6a-707a-47a7-9ad5-fc5bfdd23d96', 'c7e41b2f-0c40-4f57-94f1-59db14f767e9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:19 devstack sudo[106948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:19 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-quobyte-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a67e13-0d8d-4a7b-a829-512b1800b193]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:19 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505 1G" returned: 0 in 0.718s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e15d7829-e876-4d1d-985f-7862069b43b5 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:19 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e15d7829-e876-4d1d-985f-7862069b43b5 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505
Nov 07 02:52:19 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:19 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.408s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:19 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Deleted volume successfully.
Nov 07 02:52:19 devstack sudo[106950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102
Nov 07 02:52:19 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-324b85d6-90f6-44e2-91c3-140c4a476040 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-274e1aff-6c08-4ad2-b2d4-13db2a640e47-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:20 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e15d7829-e876-4d1d-985f-7862069b43b5 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505" returned: 0 in 0.423s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:20 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505 is being set with open permissions: ugo+rw
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:20 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102" returned: 0 in 0.528s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:20 devstack sudo[106961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505
Nov 07 02:52:20 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:20 devstack sudo[106963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102
Nov 07 02:52:20 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:20 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505" returned: 0 in 0.281s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:20 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102" released by "delete_volume" :: held 0.918s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:20 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.info
Nov 07 02:52:20 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Created reservations ['50c35c59-93f8-4615-a2d2-ce80be3ad327', 'e30bfe27-8f0c-4817-bd09-83d02a11a79f', 'fe2a754f-1dd6-4554-8138-0f72b5c3fdff', '7c058f45-6583-4b69-b2fc-b4eceb13ac6a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:20 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:20 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-4e529450-f653-4147-a60a-aea018d5af6f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-4e529450-f653-4147-a60a-aea018d5af6f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-quobyte-4e529450-f653-4147-a60a-aea018d5af6f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-4e529450-f653-4147-a60a-aea018d5af6f" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:20 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.info" returned: 0 in 0.452s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:21 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.info is being set with open permissions: ugo+rw
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa80010-f2e4-4089-a335-7e94448a55d8]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:21 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.info
Nov 07 02:52:21 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:21 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.425s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Deleted volume successfully.
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-48a58f77-e24d-435e-b756-673e63abb4e1 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-a4b06eee-2e4e-476e-8cf2-0fa6ce9cf102-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:21 devstack sudo[106973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f
Nov 07 02:52:21 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:21 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.info" returned: 0 in 0.371s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.919s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-af7bcfc5-91ab-4bf9-8073-da69103bbd13 tempest-CinderUnicodeTest-709858185 None] Create snapshot completed successfully
Nov 07 02:52:21 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f" returned: 0 in 0.523s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:21 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f
Nov 07 02:52:21 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Acquiring lock "cinder-64de4bff-7392-4c42-9e18-c1ab0fde9505-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Lock "cinder-64de4bff-7392-4c42-9e18-c1ab0fde9505-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Acquiring lock "cinder-quobyte-e15d7829-e876-4d1d-985f-7862069b43b5" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Lock "cinder-quobyte-e15d7829-e876-4d1d-985f-7862069b43b5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Acquiring lock "cinder-quobyte-64de4bff-7392-4c42-9e18-c1ab0fde9505" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Lock "cinder-quobyte-64de4bff-7392-4c42-9e18-c1ab0fde9505" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Deleting offline snapshot 64de4bff-7392-4c42-9e18-c1ab0fde9505 of volume e15d7829-e876-4d1d-985f-7862069b43b5 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] snapshot_file for this snap is: volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfee2458-efcc-41a5-aa05-41207fe645f5]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:21 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505
Nov 07 02:52:21 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:21 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4e529450-f653-4147-a60a-aea018d5af6f" returned: 0 in 0.401s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:21 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-4e529450-f653-4147-a60a-aea018d5af6f" released by "delete_volume" :: held 1.009s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Created reservations ['85f2541b-3c63-496e-aae0-d6bbd62aaab9', 'a596e916-780a-4289-b7af-4cd5f8d155ed', 'f90a514a-92e9-4ce1-97ea-2da1efa6c169', '0ca9a5a5-bf4a-45e1-9f9b-93f5b83c2f98'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:22 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:22 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:22 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505" returned: 0 in 0.504s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e15d7829-e876-4d1d-985f-7862069b43b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7847fb40-6c7a-45b3-a962-7c142a5d6d53]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-8233a8f1-9e7d-4fcf-a721-c412699a2e8e-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-8233a8f1-9e7d-4fcf-a721-c412699a2e8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-quobyte-800144a9-e1c0-4018-a478-0d7d70f03fdc" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-800144a9-e1c0-4018-a478-0d7d70f03fdc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-quobyte-8233a8f1-9e7d-4fcf-a721-c412699a2e8e" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-8233a8f1-9e7d-4fcf-a721-c412699a2e8e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Deleting offline snapshot 8233a8f1-9e7d-4fcf-a721-c412699a2e8e of volume 800144a9-e1c0-4018-a478-0d7d70f03fdc {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:22 devstack sudo[106992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5
Nov 07 02:52:22 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:22 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] snapshot_file for this snap is: volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.435s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:22 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Deleted volume successfully.
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[de62ae27-e3bb-410c-8f80-7b561b047e09]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-697b52fb-70f7-42f7-905d-ec5e9649ecfa tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-4e529450-f653-4147-a60a-aea018d5af6f-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Flow 'volume_create_manager' (d0e0cad4-aff0-420e-98d3-b2551680f487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a502b8f-0602-4f47-9c58-5bab27d2c1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a502b8f-0602-4f47-9c58-5bab27d2c1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1574190086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e648390-e450-4126-aac5-88f3b3b7322b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9733a9f9494e178ddf1e8756f9388e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:23Z,use_quota=True,user_id='cba6ae1426f6455a84328357c0dc87fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:22 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e
Nov 07 02:52:22 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66d73b1-4ff7-49d4-9fc4-702f5a10a192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66d73b1-4ff7-49d4-9fc4-702f5a10a192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d78246-f13e-4187-b1de-599e12961a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d78246-f13e-4187-b1de-599e12961a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e648390-e450-4126-aac5-88f3b3b7322b', 'volume_name': 'volume-5e648390-e450-4126-aac5-88f3b3b7322b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe9ce82-3f8a-4b66-b46e-4bbd3b9a1202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe9ce82-3f8a-4b66-b46e-4bbd3b9a1202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8dec96-42d8-4037-875f-675838621108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Volume 5e648390-e450-4126-aac5-88f3b3b7322b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e648390-e450-4126-aac5-88f3b3b7322b', 'volume_size': 1}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1574190086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e648390-e450-4126-aac5-88f3b3b7322b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9733a9f9494e178ddf1e8756f9388e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:23Z,use_quota=True,user_id='cba6ae1426f6455a84328357c0dc87fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Creating volume 5e648390-e450-4126-aac5-88f3b3b7322b {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:22 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:22 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b 1073741824
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:22 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (94ef7b48-b35f-45e5-93de-f958945954da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40387bb-70d2-41c8-971f-104337720fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:22 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5" returned: 0 in 0.524s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40387bb-70d2-41c8-971f-104337720fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1165713097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31352a59-272e-4013-8b86-6880b120254f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:23Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:22 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505
Nov 07 02:52:22 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c5a729-916d-4d31-b42e-0e9adb8a57ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c5a729-916d-4d31-b42e-0e9adb8a57ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f4de61-5610-497b-8419-676303b67c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f4de61-5610-497b-8419-676303b67c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31352a59-272e-4013-8b86-6880b120254f', 'volume_name': 'volume-31352a59-272e-4013-8b86-6880b120254f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e681e60c-70f1-4314-95a4-6a313844077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e681e60c-70f1-4314-95a4-6a313844077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352adc6b-0c21-41c5-b69e-863e87605cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:22 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Volume 31352a59-272e-4013-8b86-6880b120254f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31352a59-272e-4013-8b86-6880b120254f', 'volume_size': 1}
Nov 07 02:52:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:23 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e" returned: 0 in 0.457s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800144a9-e1c0-4018-a478-0d7d70f03fdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee84e85-4c0b-47cd-ba84-5d02c42e6c59]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:23 devstack sudo[107010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc
Nov 07 02:52:23 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:23 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505" returned: 0 in 0.385s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:23 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505
Nov 07 02:52:23 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:23 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b 1073741824" returned: 0 in 0.508s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:23 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b
Nov 07 02:52:23 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:23 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5.64de4bff-7392-4c42-9e18-c1ab0fde9505" returned: 0 in 0.281s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:23 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc" returned: 0 in 0.469s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:23 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e
Nov 07 02:52:23 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Lock "cinder-quobyte-64de4bff-7392-4c42-9e18-c1ab0fde9505" released by "_delete_snapshot" :: held 1.858s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Lock "cinder-quobyte-e15d7829-e876-4d1d-985f-7862069b43b5" released by "delete_snapshot" :: held 1.881s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:23 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b" returned: 0 in 0.319s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.746s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1165713097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31352a59-272e-4013-8b86-6880b120254f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:23Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Creating volume 31352a59-272e-4013-8b86-6880b120254f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:23 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Created reservations ['737f7067-b124-4b79-874f-75083ff3108e', '9edf90fd-b1fe-4532-b6e9-f7fbee926739', '1df4f3e6-45c1-41b4-84ff-a3d328ff520e', 'b75fb7eb-ba45-42da-87dc-258ed3762a2a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8dec96-42d8-4037-875f-675838621108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e648390-e450-4126-aac5-88f3b3b7322b', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d69b82-bfce-4644-a206-191b27833f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:23 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f 1073741824
Nov 07 02:52:23 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:23 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Volume volume-5e648390-e450-4126-aac5-88f3b3b7322b (5e648390-e450-4126-aac5-88f3b3b7322b): created successfully
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d69b82-bfce-4644-a206-191b27833f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Flow 'volume_create_manager' (d0e0cad4-aff0-420e-98d3-b2551680f487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1a9820fa-3983-45c4-bbb7-da8dde2115ef tempest-VolumeDependencyTests-959339830 None] Created volume successfully.
Nov 07 02:52:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Delete snapshot completed successfully.
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b1475a68-923c-469e-9a39-eca499b536b7 tempest-CinderUnicodeTest-709858185 None] Lock "cinder-64de4bff-7392-4c42-9e18-c1ab0fde9505-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Acquiring lock "cinder-e15d7829-e876-4d1d-985f-7862069b43b5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Lock "cinder-e15d7829-e876-4d1d-985f-7862069b43b5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Acquiring lock "cinder-quobyte-e15d7829-e876-4d1d-985f-7862069b43b5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:23 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Lock "cinder-quobyte-e15d7829-e876-4d1d-985f-7862069b43b5" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e" returned: 0 in 0.437s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf18f4b-c641-4e54-b488-c323afd5b7ee]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:24 devstack sudo[107036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e
Nov 07 02:52:24 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:24 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5
Nov 07 02:52:24 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:24 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f 1073741824" returned: 0 in 0.519s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:24 devstack sudo[107041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f
Nov 07 02:52:24 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:24 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc.8233a8f1-9e7d-4fcf-a721-c412699a2e8e" returned: 0 in 0.319s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-8233a8f1-9e7d-4fcf-a721-c412699a2e8e" released by "_delete_snapshot" :: held 1.819s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-800144a9-e1c0-4018-a478-0d7d70f03fdc" released by "delete_snapshot" :: held 1.848s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:24 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5" returned: 0 in 0.398s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Created reservations ['1074fd92-e683-4c5d-b59e-7f07536fdd8a', '7dac4b4c-90e0-47c6-b99e-ed6b613f875d', 'b883ff2f-d485-4c50-abd5-ee4e83c278c5', '6a49940c-7f44-499d-9d84-5c00de6dd64f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:24 devstack sudo[107047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5
Nov 07 02:52:24 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Delete snapshot completed successfully.
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8c197375-402d-474a-ab46-472a077c80d6 tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-8233a8f1-9e7d-4fcf-a721-c412699a2e8e-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:24 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f" returned: 0 in 0.299s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352adc6b-0c21-41c5-b69e-863e87605cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31352a59-272e-4013-8b86-6880b120254f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2c969e-86ae-40ed-8567-929eee191c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:24 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Volume volume-31352a59-272e-4013-8b86-6880b120254f (31352a59-272e-4013-8b86-6880b120254f): created successfully
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2c969e-86ae-40ed-8567-929eee191c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (94ef7b48-b35f-45e5-93de-f958945954da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-47e70f78-51f7-4e49-b42e-70fc89d78abe tempest-ProjectMemberTests-1264181528 None] Created volume successfully.
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-800144a9-e1c0-4018-a478-0d7d70f03fdc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-800144a9-e1c0-4018-a478-0d7d70f03fdc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:24 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-e15d7829-e876-4d1d-985f-7862069b43b5" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Lock "cinder-quobyte-e15d7829-e876-4d1d-985f-7862069b43b5" released by "delete_volume" :: held 0.829s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "cinder-quobyte-800144a9-e1c0-4018-a478-0d7d70f03fdc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] Creating offline snapshot ef42fe32-c9b5-4af0-acb8-25326362ad2d of volume 5e648390-e450-4126-aac5-88f3b3b7322b {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc592afc-eedd-4095-b622-b8944fa21f2e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-800144a9-e1c0-4018-a478-0d7d70f03fdc" acquired by "delete_volume" :: waited 0.032s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8da9a03-5b74-4c78-8c66-c30191935698]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:24 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Created reservations ['cb211491-c6a0-4408-ae8b-e9153c0925bb', 'e57982d0-a6b0-455f-b894-f2c8a2420e65', '39110195-16cb-44f1-92cd-ad0be20dffe4', '3b39a5b4-9681-472f-805c-2567757cc910'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:25 devstack sudo[107051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:25 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:25 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc
Nov 07 02:52:25 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:25 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:25 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Acquiring lock "cinder-ce55b5d2-43aa-4e73-a464-5b42170f3ad5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Lock "cinder-ce55b5d2-43aa-4e73-a464-5b42170f3ad5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Acquiring lock "cinder-quobyte-ce55b5d2-43aa-4e73-a464-5b42170f3ad5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Lock "cinder-quobyte-ce55b5d2-43aa-4e73-a464-5b42170f3ad5" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[49075b44-1ec6-4c69-a461-72330e2144ca]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:25 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:25 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc" returned: 0 in 0.433s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b" returned: 0 in 0.451s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:25 devstack sudo[107065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc
Nov 07 02:52:25 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:25 devstack sudo[107066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d 1G
Nov 07 02:52:25 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:25 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Deleted volume successfully.
Nov 07 02:52:25 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7cc51ab5-5cd5-438a-81d8-492fbe7a987a tempest-CinderUnicodeTest-709858185 None] Lock "cinder-e15d7829-e876-4d1d-985f-7862069b43b5-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:25 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:25 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-800144a9-e1c0-4018-a478-0d7d70f03fdc" returned: 0 in 0.273s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-quobyte-800144a9-e1c0-4018-a478-0d7d70f03fdc" released by "delete_volume" :: held 0.774s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Created reservations ['dcf951d8-8f1f-434c-bc2b-6d65667b1a80', '18fb7fc2-58d5-4126-b9b0-e2fb3a0ef950', '2b8a8fbc-1a14-422b-bb08-23aac6b4d925', '7dd007cb-4361-4ea8-a5f5-be19b197c136'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:25 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5" returned: 0 in 0.439s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:25 devstack sudo[107079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5
Nov 07 02:52:25 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:25 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d 1G" returned: 0 in 0.517s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e648390-e450-4126-aac5-88f3b3b7322b -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:25 devstack sudo[107081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:25 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:25 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e648390-e450-4126-aac5-88f3b3b7322b -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d
Nov 07 02:52:25 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:26 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-ce55b5d2-43aa-4e73-a464-5b42170f3ad5" returned: 0 in 0.357s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Lock "cinder-quobyte-ce55b5d2-43aa-4e73-a464-5b42170f3ad5" released by "delete_volume" :: held 0.857s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:26 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.403s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Deleted volume successfully.
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Created reservations ['bd960642-29ac-4e6a-8015-bbd53bc599e5', '0f3c84cf-9777-4e8e-a398-cbdc3c3fd299', '2cbc4b38-9c2c-45f9-9e39-936595616875', '98945bb7-0c5d-438d-9b9c-8205c00587f0'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-dd117323-a542-48dc-9a61-f0720e12a09a tempest-CreateVolumesFromSnapshotTest-823391122 None] Lock "cinder-800144a9-e1c0-4018-a478-0d7d70f03fdc-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:26 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e648390-e450-4126-aac5-88f3b3b7322b -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d" returned: 0 in 0.514s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:26 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d is being set with open permissions: ugo+rw
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:26 devstack sudo[107091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d
Nov 07 02:52:26 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:26 devstack sudo[107093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:26 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:26 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d" returned: 0 in 0.266s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:26 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.267s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Deleted volume successfully.
Nov 07 02:52:26 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.info
Nov 07 02:52:26 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3f51b2a9-cc2b-45b5-a737-c6c5d3a52ae0 tempest-CinderUnicodeTest-709858185 None] Lock "cinder-ce55b5d2-43aa-4e73-a464-5b42170f3ad5-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:26 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.info" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:26 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.info is being set with open permissions: ugo+rw
Nov 07 02:52:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:27 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.info
Nov 07 02:52:27 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:27 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.info" returned: 0 in 0.269s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.863s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] Creating offline snapshot 1564225e-077c-4222-ad68-0b3247a974b5 of volume 31352a59-272e-4013-8b86-6880b120254f {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:27 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-548c6865-2afc-4155-8b2d-2f9a82d8e409 tempest-VolumeDependencyTests-959339830 None] Create snapshot completed successfully
Nov 07 02:52:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[283b0f58-6f0d-41bc-9a70-e49155d7e982]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:27 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f
Nov 07 02:52:27 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:27 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f" returned: 0 in 0.434s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:27 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5 1G
Nov 07 02:52:27 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:28 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5 1G" returned: 0 in 0.527s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31352a59-272e-4013-8b86-6880b120254f -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:28 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31352a59-272e-4013-8b86-6880b120254f -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5
Nov 07 02:52:28 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Flow 'volume_create_manager' (80ae40e9-2f49-4845-8220-89805c668af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5697757-759d-4876-a10c-5d3a3df504db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5697757-759d-4876-a10c-5d3a3df504db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1285593473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69352583-54a3-4b35-9d00-135f43644e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9733a9f9494e178ddf1e8756f9388e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef42fe32-c9b5-4af0-acb8-25326362ad2d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:29Z,use_quota=True,user_id='cba6ae1426f6455a84328357c0dc87fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:28 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79828b99-6c65-46b6-98c2-78831ceb6678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79828b99-6c65-46b6-98c2-78831ceb6678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343b83b6-b230-4bf8-948a-871bf2b2a4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343b83b6-b230-4bf8-948a-871bf2b2a4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69352583-54a3-4b35-9d00-135f43644e4e', 'volume_name': 'volume-69352583-54a3-4b35-9d00-135f43644e4e', 'volume_size': 1, 'snapshot_id': 'ef42fe32-c9b5-4af0-acb8-25326362ad2d'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1e1452-4a44-4655-baa9-c34b4f09b8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1e1452-4a44-4655-baa9-c34b4f09b8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28a41f1-01ff-4643-a43a-3eb3d26e14ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:28 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Volume 69352583-54a3-4b35-9d00-135f43644e4e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69352583-54a3-4b35-9d00-135f43644e4e', 'volume_size': 1, 'snapshot_id': 'ef42fe32-c9b5-4af0-acb8-25326362ad2d'}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31352a59-272e-4013-8b86-6880b120254f -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5" returned: 0 in 0.537s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:28 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5 is being set with open permissions: ugo+rw
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:28 devstack sudo[107122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5
Nov 07 02:52:28 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:29 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5" returned: 0 in 0.307s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:29 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.info
Nov 07 02:52:29 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:29 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.info" returned: 0 in 0.283s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:29 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.info is being set with open permissions: ugo+rw
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:29 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.info
Nov 07 02:52:29 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:29 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.info" returned: 0 in 0.293s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.925s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Acquiring lock "cinder-quobyte-ef42fe32-c9b5-4af0-acb8-25326362ad2d-69352583-54a3-4b35-9d00-135f43644e4e" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-ef42fe32-c9b5-4af0-acb8-25326362ad2d-69352583-54a3-4b35-9d00-135f43644e4e" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Creating volume 69352583-54a3-4b35-9d00-135f43644e4e from snapshot ef42fe32-c9b5-4af0-acb8-25326362ad2d {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Acquiring lock "cinder-quobyte-69352583-54a3-4b35-9d00-135f43644e4e" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-df69e0c2-a5d2-431f-b476-c6ed3e5cf4d1 tempest-ProjectMemberTests-1264181528 None] Create snapshot completed successfully
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-69352583-54a3-4b35-9d00-135f43644e4e" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] snapshot: ef42fe32-c9b5-4af0-acb8-25326362ad2d, volume: 69352583-54a3-4b35-9d00-135f43644e4e,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3d82d5-a251-40f4-954e-a1d7469fc9d6]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:30 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d
Nov 07 02:52:30 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:30 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e648390-e450-4126-aac5-88f3b3b7322b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e073dede-d272-46cf-a1c6-c4c46640a53c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:30 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b
Nov 07 02:52:30 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-1564225e-077c-4222-ad68-0b3247a974b5-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-1564225e-077c-4222-ad68-0b3247a974b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-31352a59-272e-4013-8b86-6880b120254f" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-31352a59-272e-4013-8b86-6880b120254f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-1564225e-077c-4222-ad68-0b3247a974b5" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-1564225e-077c-4222-ad68-0b3247a974b5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Deleting offline snapshot 1564225e-077c-4222-ad68-0b3247a974b5 of volume 31352a59-272e-4013-8b86-6880b120254f {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] snapshot_file for this snap is: volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f059e97-3f1e-4417-95fa-ce07757366ad]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:30 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b" returned: 0 in 0.446s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:52:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:30 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e
Nov 07 02:52:30 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:30 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5
Nov 07 02:52:30 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:31 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5" returned: 0 in 0.448s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:31 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31352a59-272e-4013-8b86-6880b120254f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:31 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b440587d-1d84-4bd3-b79f-2fec83080066]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:31 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f
Nov 07 02:52:31 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:32 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f" returned: 0 in 0.765s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:32 devstack sudo[107164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5
Nov 07 02:52:32 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Flow 'volume_create_manager' (b45e9520-b2da-4701-97e8-94af841b6558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22b3712-9c0d-4103-a632-6446ce3d5eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22b3712-9c0d-4103-a632-6446ce3d5eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659753703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eaf28a8-ecdf-4b55-ba89-a6107f4d3003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f8124e1a01410db31a360d3a075b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:32Z,use_quota=True,user_id='e45f050e2f544e2595ba850c10530d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb010e8-1d97-47ed-a75c-c2f7e3581e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb010e8-1d97-47ed-a75c-c2f7e3581e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206187bd-8781-40e0-8306-fdd8688611a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206187bd-8781-40e0-8306-fdd8688611a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eaf28a8-ecdf-4b55-ba89-a6107f4d3003', 'volume_name': 'volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7c8c6e-87e2-4b8a-af15-73f849bba736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7c8c6e-87e2-4b8a-af15-73f849bba736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9599f34a-ff47-45a6-8f17-5f11506cccd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:32 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Volume 1eaf28a8-ecdf-4b55-ba89-a6107f4d3003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003', 'volume_size': 1}
Nov 07 02:52:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:33 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5" returned: 0 in 1.055s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:33 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5
Nov 07 02:52:33 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Flow 'volume_create_manager' (5d2d862a-db67-4ccc-ab3c-0a81195bebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aac3996-9103-4e96-9f94-d17e41de027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aac3996-9103-4e96-9f94-d17e41de027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89ef57a-a1e2-4170-9181-403c5f262076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32291d8baca940e9bfd0dac4d80508f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:33Z,use_quota=True,user_id='c678f6e6e8c64c0da703ae094c4ed4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd97f8e-04b7-4c05-9ae4-7315a2cbb2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd97f8e-04b7-4c05-9ae4-7315a2cbb2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4ad25a-83cc-4c5c-a113-9bd2ceb8f7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG cinder.image.glance [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Creating Keystone auth plugin from conf {{(pid=87087) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:52:33 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f.1564225e-077c-4222-ad68-0b3247a974b5" returned: 0 in 0.689s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-1564225e-077c-4222-ad68-0b3247a974b5" released by "_delete_snapshot" :: held 3.166s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-31352a59-272e-4013-8b86-6880b120254f" released by "delete_snapshot" :: held 3.209s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:34 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Created reservations ['a9af6ac8-f2e5-45f9-8b14-f0ff00335e67', 'f15a5af0-b7be-4154-b70c-3f943acfe4ea', 'b733ed03-9bce-4860-abd0-fa4572acad76', '7b05a351-5eb4-481d-8b03-76c0d7f84ee6'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Delete snapshot completed successfully.
Nov 07 02:52:34 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-045e8e37-2d89-4818-808f-4fdb000360dc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-1564225e-077c-4222-ad68-0b3247a974b5-delete_snapshot" released by "delete_snapshot" :: held 3.515s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4ad25a-83cc-4c5c-a113-9bd2ceb8f7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd89ef57a-a1e2-4170-9181-403c5f262076', 'volume_name': 'volume-d89ef57a-a1e2-4170-9181-403c5f262076', 'volume_size': 1, 'image_id': '9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a614e800a0ceed589ff9d88431c60661', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '32291d8baca940e9bfd0dac4d80508f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee8a3f76ad5b36ceb142b941829be4c6ddadbf93c973926d75d22a6f8024cfbe484c6f13deb17399c0d9810e537e7c895a7a0aa26326de998da9b2f669c54205', 'id': '9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'created_at': datetime.datetime(2026, 11, 7, 1, 52, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 52, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d3e6d10-ef0d-4f80-8dfc-db93d015c320/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696f0ea9ee0>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46679c0-5cba-460e-b8b4-77783516e6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46679c0-5cba-460e-b8b4-77783516e6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b926da92-2515-4071-9121-eebc4d32dbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Volume d89ef57a-a1e2-4170-9181-403c5f262076: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d89ef57a-a1e2-4170-9181-403c5f262076', 'volume_size': 1, 'image_id': '9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a614e800a0ceed589ff9d88431c60661', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '32291d8baca940e9bfd0dac4d80508f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee8a3f76ad5b36ceb142b941829be4c6ddadbf93c973926d75d22a6f8024cfbe484c6f13deb17399c0d9810e537e7c895a7a0aa26326de998da9b2f669c54205', 'id': '9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'created_at': datetime.datetime(2026, 11, 7, 1, 52, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 52, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d3e6d10-ef0d-4f80-8dfc-db93d015c320/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696f0ea9ee0>}
Nov 07 02:52:34 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Trying to clone d89ef57a-a1e2-4170-9181-403c5f262076 from image 9d3e6d10-ef0d-4f80-8dfc-db93d015c320 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'metadata': {}}]). {{(pid=87087) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:52:34 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:52:34 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Image download 0.00 MB at 0.00 MB/s
Nov 07 02:52:34 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe27cb2-6d17-46db-b8c9-674d406dc3a7]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:34 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD
Nov 07 02:52:34 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:35 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-31352a59-272e-4013-8b86-6880b120254f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Lock "cinder-31352a59-272e-4013-8b86-6880b120254f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:35 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD
Nov 07 02:52:35 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-31352a59-272e-4013-8b86-6880b120254f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-31352a59-272e-4013-8b86-6880b120254f" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f208472-db02-47c5-af16-bf2bb75c2881]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:35 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Temporary image 9d3e6d10-ef0d-4f80-8dfc-db93d015c320 is fetched for user c678f6e6e8c64c0da703ae094c4ed4b5. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:52:35 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f
Nov 07 02:52:35 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89ae2bc-e298-4bef-9183-61fbdce0d290]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:35 devstack sudo[107184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD
Nov 07 02:52:35 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:36 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f" returned: 0 in 0.678s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:36 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f
Nov 07 02:52:36 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:36 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD" returned: 0 in 0.654s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:36 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-31352a59-272e-4013-8b86-6880b120254f" returned: 0 in 0.407s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-31352a59-272e-4013-8b86-6880b120254f" released by "delete_volume" :: held 1.251s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:36 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD
Nov 07 02:52:36 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Created reservations ['ae2f2fa6-1b4f-4e9f-a99f-75f9f80329d7', '8c28b801-84a1-4d43-bf62-179342bf39c2', 'e30d1f47-e8f4-45d2-9076-4fd2e7caaa53', '9963a0e6-c545-4011-bcef-cc53c4a94767'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:36 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD" returned: 1 in 0.543s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:52:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:36 devstack sudo[107200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:36 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:37 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.454s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:37 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Deleted volume successfully.
Nov 07 02:52:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5c8aad85-5696-48fa-b323-7a3558551b1d tempest-ProjectMemberTests-1264181528 None] Lock "cinder-31352a59-272e-4013-8b86-6880b120254f-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (85c858c6-b9aa-44f4-90fe-c628b3cd9be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18994852-e1f2-4c2f-be25-49a8eb84e94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18994852-e1f2-4c2f-be25-49a8eb84e94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300796376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:38Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cfdc18-7812-401e-99df-5a96ec2b7f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cfdc18-7812-401e-99df-5a96ec2b7f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561f4336-ca07-4fea-aada-dfa59f24151a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561f4336-ca07-4fea-aada-dfa59f24151a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d', 'volume_name': 'volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa46449f-4795-41b4-afb7-0aafe839a44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa46449f-4795-41b4-afb7-0aafe839a44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2758a3da-c0f3-41cb-8007-c66df054b20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:38 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Volume d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d', 'volume_size': 1}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:38 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e" returned: 0 in 7.990s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b, size 1024.00 MB, duration 7.99 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:52:38 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Converted 1024.00 MB image at 128.15 MB/s
Nov 07 02:52:38 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e is being set with open permissions: ugo+rw
Nov 07 02:52:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:38 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e
Nov 07 02:52:38 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:39 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e" returned: 0 in 0.253s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-69352583-54a3-4b35-9d00-135f43644e4e" released by "_copy_volume_from_snapshot" :: held 9.222s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-ef42fe32-c9b5-4af0-acb8-25326362ad2d-69352583-54a3-4b35-9d00-135f43644e4e" released by "_create_volume_from_snapshot" :: held 9.297s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.326s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.450s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659753703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eaf28a8-ecdf-4b55-ba89-a6107f4d3003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f8124e1a01410db31a360d3a075b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:32Z,use_quota=True,user_id='e45f050e2f544e2595ba850c10530d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Creating volume 1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:39 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:39 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 1073741824
Nov 07 02:52:39 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28a41f1-01ff-4643-a43a-3eb3d26e14ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69352583-54a3-4b35-9d00-135f43644e4e', 'volume_size': 1, 'snapshot_id': 'ef42fe32-c9b5-4af0-acb8-25326362ad2d'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ff097d-6b57-45ad-9e5c-56c4e8b3178c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Volume volume-69352583-54a3-4b35-9d00-135f43644e4e (69352583-54a3-4b35-9d00-135f43644e4e): created successfully
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ff097d-6b57-45ad-9e5c-56c4e8b3178c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Flow 'volume_create_manager' (80ae40e9-2f49-4845-8220-89805c668af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-53fb8f4b-bb67-4d3f-811a-66deae3574fa tempest-VolumeDependencyTests-959339830 None] Created volume successfully.
Nov 07 02:52:39 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 1073741824" returned: 0 in 0.421s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Acquiring lock "cinder-ef42fe32-c9b5-4af0-acb8-25326362ad2d-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:39 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003
Nov 07 02:52:39 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-ef42fe32-c9b5-4af0-acb8-25326362ad2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Acquiring lock "cinder-quobyte-5e648390-e450-4126-aac5-88f3b3b7322b" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-5e648390-e450-4126-aac5-88f3b3b7322b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Acquiring lock "cinder-quobyte-ef42fe32-c9b5-4af0-acb8-25326362ad2d" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-ef42fe32-c9b5-4af0-acb8-25326362ad2d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Deleting offline snapshot ef42fe32-c9b5-4af0-acb8-25326362ad2d of volume 5e648390-e450-4126-aac5-88f3b3b7322b {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] snapshot_file for this snap is: volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5bac76-83bc-4de0-968e-7c222a178a0c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:39 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d
Nov 07 02:52:39 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:39 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003" returned: 0 in 0.271s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.966s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89ef57a-a1e2-4170-9181-403c5f262076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32291d8baca940e9bfd0dac4d80508f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:33Z,use_quota=True,user_id='c678f6e6e8c64c0da703ae094c4ed4b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Creating volume d89ef57a-a1e2-4170-9181-403c5f262076 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:39 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9599f34a-ff47-45a6-8f17-5f11506cccd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:39 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076 1073741824
Nov 07 02:52:39 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467032d2-4a87-4ac4-a01e-55ce865d2950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:39 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Volume volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 (1eaf28a8-ecdf-4b55-ba89-a6107f4d3003): created successfully
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467032d2-4a87-4ac4-a01e-55ce865d2950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:39 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Flow 'volume_create_manager' (b45e9520-b2da-4701-97e8-94af841b6558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5d0afe5c-4b6b-4199-bf3a-bfe463b2183f tempest-ProjectReaderTests-344415422 None] Created volume successfully.
Nov 07 02:52:40 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d" returned: 0 in 0.388s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e648390-e450-4126-aac5-88f3b3b7322b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa798328-4335-43b7-a983-fb46542d9b96]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:40 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b
Nov 07 02:52:40 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:40 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076 1073741824" returned: 0 in 0.439s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:40 devstack sudo[107229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076
Nov 07 02:52:40 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:40 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076" returned: 0 in 0.267s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.108s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300796376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:38Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Creating volume d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:40 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:40 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b" returned: 0 in 0.552s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:40 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d 1073741824
Nov 07 02:52:40 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Attempting download of 9d3e6d10-ef0d-4f80-8dfc-db93d015c320 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'metadata': {}}])) to volume d89ef57a-a1e2-4170-9181-403c5f262076. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:52:40 devstack sudo[107236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d
Nov 07 02:52:40 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f66e485-ab4f-4275-9e6e-67e9e9a75c96]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_mg78b3mf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:40 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_mg78b3mf
Nov 07 02:52:40 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:41 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d" returned: 0 in 0.402s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:41 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d
Nov 07 02:52:41 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:41 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d 1073741824" returned: 0 in 0.547s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:41 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_mg78b3mf" returned: 0 in 0.483s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_mg78b3mf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:41 devstack sudo[107289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d
Nov 07 02:52:41 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:41 devstack sudo[107286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_mg78b3mf
Nov 07 02:52:41 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:41 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b.ef42fe32-c9b5-4af0-acb8-25326362ad2d" returned: 0 in 0.426s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-ef42fe32-c9b5-4af0-acb8-25326362ad2d" released by "_delete_snapshot" :: held 1.877s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-5e648390-e450-4126-aac5-88f3b3b7322b" released by "delete_snapshot" :: held 1.904s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Created reservations ['072c8b79-5f74-4100-8fcf-4ddaecfe8673', '747726a1-9ae0-4211-9e2b-2f8682741599', '5f017029-f71a-41d0-b05f-050883196be7', 'db1075f2-6aa8-4808-a929-c41e36addf68'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:41 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.169s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] Creating offline snapshot 7b552df7-0e37-4e04-84d1-844c6b982ccf of volume 1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2758a3da-c0f3-41cb-8007-c66df054b20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df077ff-15f6-4a6b-a9fe-41a6423409e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55bcf59-2355-401d-95b7-a176d2cab055]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:41 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_mg78b3mf" returned: 1 in 0.479s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_mg78b3mf' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdcf8f0-e8c8-42b4-912f-12c1b7fd9c07]: (4, 'raw') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:41 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Volume volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d (d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d): created successfully
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df077ff-15f6-4a6b-a9fe-41a6423409e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (85c858c6-b9aa-44f4-90fe-c628b3cd9be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Delete snapshot completed successfully.
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Acquiring lock "cinder-5e648390-e450-4126-aac5-88f3b3b7322b-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:41 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1cbd61a3-03eb-490a-a629-942cfdf05eff tempest-ProjectMemberTests-1264181528 None] Created volume successfully.
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7fa1fc84-600c-4e99-a43f-49068b3560f7 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-ef42fe32-c9b5-4af0-acb8-25326362ad2d-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-5e648390-e450-4126-aac5-88f3b3b7322b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:41 devstack sudo[107296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003
Nov 07 02:52:41 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Acquiring lock "cinder-quobyte-5e648390-e450-4126-aac5-88f3b3b7322b" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:41 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD
Nov 07 02:52:41 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-5e648390-e450-4126-aac5-88f3b3b7322b" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea08bb4-11bf-494e-b718-e9cae65f60bd]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:42 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b
Nov 07 02:52:42 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:42 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:42 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003" returned: 0 in 0.455s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:42 devstack sudo[107309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf 1G
Nov 07 02:52:42 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:42 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD
Nov 07 02:52:42 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:42 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b" returned: 0 in 0.411s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:42 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b
Nov 07 02:52:42 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:42 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] 9d3e6d10-ef0d-4f80-8dfc-db93d015c320 was raw, converting to qcow2 {{(pid=87087) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:42 devstack sudo[107323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076
Nov 07 02:52:42 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:42 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5e648390-e450-4126-aac5-88f3b3b7322b" returned: 0 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:42 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf 1G" returned: 0 in 0.553s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-5e648390-e450-4126-aac5-88f3b3b7322b" released by "delete_volume" :: held 0.826s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:42 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf
Nov 07 02:52:42 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Created reservations ['9cadf869-b537-4644-8e3f-7a0e934acbc6', 'e2dce4f5-7b47-4af4-8091-0fb3b73b03d2', '1060c415-de9b-4bf9-87fb-05326a8c3bc4', 'bfea96f5-d4ac-46fa-b1ba-c285fdff4fec'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:42 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:42 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Acquiring lock "cinder-69352583-54a3-4b35-9d00-135f43644e4e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-69352583-54a3-4b35-9d00-135f43644e4e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Acquiring lock "cinder-quobyte-69352583-54a3-4b35-9d00-135f43644e4e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:43 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf" returned: 0 in 0.396s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:43 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf is being set with open permissions: ugo+rw
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-69352583-54a3-4b35-9d00-135f43644e4e" acquired by "delete_volume" :: waited 0.035s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:43 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf
Nov 07 02:52:43 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a752cf0a-8d60-4b49-ac72-1901eca718e6]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:43 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076" returned: 0 in 0.665s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d3e6d10-ef0d-4f80-8dfc-db93d015c320_8wvxo2fudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076 {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:52:43 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Converted 0.00 MB image at 0.00 MB/s
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:43 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076 1G
Nov 07 02:52:43 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:43 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.342s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Deleted volume successfully.
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-27d4e78e-198d-4ec7-b50e-207ade4fac17 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-5e648390-e450-4126-aac5-88f3b3b7322b-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:43 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e
Nov 07 02:52:43 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:43 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:43 devstack sudo[107347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.info
Nov 07 02:52:43 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:43 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076 1G" returned: 0 in 0.370s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Downloaded image 9d3e6d10-ef0d-4f80-8dfc-db93d015c320 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'metadata': {}}])) to volume d89ef57a-a1e2-4170-9181-403c5f262076 successfully. {{(pid=87087) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Temporary image 9d3e6d10-ef0d-4f80-8dfc-db93d015c320 for user c678f6e6e8c64c0da703ae094c4ed4b5 is deleted. {{(pid=87087) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.volume.volume_utils [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Marking volume d89ef57a-a1e2-4170-9181-403c5f262076 as bootable. {{(pid=87087) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Copying metadata from image 9d3e6d10-ef0d-4f80-8dfc-db93d015c320 to d89ef57a-a1e2-4170-9181-403c5f262076. {{(pid=87087) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Creating volume glance metadata for volume d89ef57a-a1e2-4170-9181-403c5f262076 backed by image 9d3e6d10-ef0d-4f80-8dfc-db93d015c320 with: {'image_id': '9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a614e800a0ceed589ff9d88431c60661', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87087) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:52:43 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e" returned: 0 in 0.414s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:43 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e
Nov 07 02:52:43 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b926da92-2515-4071-9121-eebc4d32dbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d89ef57a-a1e2-4170-9181-403c5f262076', 'volume_size': 1, 'image_id': '9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a614e800a0ceed589ff9d88431c60661', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '32291d8baca940e9bfd0dac4d80508f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee8a3f76ad5b36ceb142b941829be4c6ddadbf93c973926d75d22a6f8024cfbe484c6f13deb17399c0d9810e537e7c895a7a0aa26326de998da9b2f669c54205', 'id': '9d3e6d10-ef0d-4f80-8dfc-db93d015c320', 'created_at': datetime.datetime(2026, 11, 7, 1, 52, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 52, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d3e6d10-ef0d-4f80-8dfc-db93d015c320/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7696f0ea9ee0>}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6887af46-6176-4975-9663-d19d53b7b47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:43 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Volume volume-d89ef57a-a1e2-4170-9181-403c5f262076 (d89ef57a-a1e2-4170-9181-403c5f262076): created successfully
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6887af46-6176-4975-9663-d19d53b7b47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Flow 'volume_create_manager' (5d2d862a-db67-4ccc-ab3c-0a81195bebde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:43 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-a6e5d2f4-3829-4bb4-afe9-96126a327128 tempest-VolumeImageDependencyTests-1122760951 None] Created volume successfully.
Nov 07 02:52:43 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.info" returned: 0 in 0.296s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:43 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.info is being set with open permissions: ugo+rw
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:43 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.info
Nov 07 02:52:43 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:43 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-69352583-54a3-4b35-9d00-135f43644e4e" returned: 0 in 0.281s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-quobyte-69352583-54a3-4b35-9d00-135f43644e4e" released by "delete_volume" :: held 0.756s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:43 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Created reservations ['0c2c81e8-9414-4de2-9317-7111a9eb0c8a', 'c8c56e50-b3ef-4234-bb00-b502784f246d', 'a5d35fd1-d2fb-47ac-b273-8a97461dd91d', 'bb9d4065-5a8e-4162-87ee-1047edde4bdd'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:43 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.info" returned: 0 in 0.277s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.186s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:44 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:44 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] Creating offline snapshot 36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 of volume d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-04731d05-8e95-4878-892d-3b0ff000c850 tempest-ProjectReaderTests-344415422 None] Create snapshot completed successfully
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51bab8f-224f-4314-83a3-40b31f6281b2]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:44 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d
Nov 07 02:52:44 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:44 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.275s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:44 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Deleted volume successfully.
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-b74c1714-4d2b-4598-a257-6521853ee192 tempest-VolumeDependencyTests-959339830 None] Lock "cinder-69352583-54a3-4b35-9d00-135f43644e4e-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:44 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d" returned: 0 in 0.429s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Acquiring lock "cinder-d89ef57a-a1e2-4170-9181-403c5f262076-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:44 devstack sudo[107370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 1G
Nov 07 02:52:44 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Lock "cinder-d89ef57a-a1e2-4170-9181-403c5f262076-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Acquiring lock "cinder-quobyte-d89ef57a-a1e2-4170-9181-403c5f262076" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Lock "cinder-quobyte-d89ef57a-a1e2-4170-9181-403c5f262076" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ed6c51-3a57-4a49-b81f-cf491f48b3f0]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:44 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076
Nov 07 02:52:44 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:44 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-7b552df7-0e37-4e04-84d1-844c6b982ccf-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Lock "cinder-7b552df7-0e37-4e04-84d1-844c6b982ccf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-7b552df7-0e37-4e04-84d1-844c6b982ccf" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-7b552df7-0e37-4e04-84d1-844c6b982ccf" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Deleting offline snapshot 7b552df7-0e37-4e04-84d1-844c6b982ccf of volume 1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] snapshot_file for this snap is: volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[374fe28e-06c8-4604-b0e4-37f1841d1c77]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:45 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 1G" returned: 0 in 0.604s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:45 devstack sudo[107378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9
Nov 07 02:52:45 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:45 devstack sudo[107377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf
Nov 07 02:52:45 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:45 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076" returned: 0 in 0.567s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:45 devstack sudo[107385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076
Nov 07 02:52:45 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:45 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9" returned: 0 in 0.370s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:45 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 is being set with open permissions: ugo+rw
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:45 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9
Nov 07 02:52:45 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:45 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf" returned: 0 in 0.466s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:45 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d89ef57a-a1e2-4170-9181-403c5f262076" returned: 0 in 0.315s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Lock "cinder-quobyte-d89ef57a-a1e2-4170-9181-403c5f262076" released by "delete_volume" :: held 0.945s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e428fd7-5fea-4005-b665-8ed5d3f985d5]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Created reservations ['f466ad89-0e2d-48f7-93b2-0193893b837f', '28fa3341-2ed0-42ab-8cdb-6711f5b7f510', '0d92948f-88b4-439a-b8b9-12bbf3b49e3d', '1b375f00-c26f-4ade-8fd8-00f0f11e4d15'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:45 devstack sudo[107399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003
Nov 07 02:52:45 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:45 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:45 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:45 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9" returned: 0 in 0.411s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:46 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.info
Nov 07 02:52:46 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:46 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:46 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003" returned: 0 in 0.537s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.355s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Deleted volume successfully.
Nov 07 02:52:46 devstack sudo[107410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf
Nov 07 02:52:46 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-127577a2-ced2-483e-833b-cf10e86268a9 tempest-VolumeImageDependencyTests-1122760951 None] Lock "cinder-d89ef57a-a1e2-4170-9181-403c5f262076-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:46 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.info" returned: 0 in 0.329s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:46 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.info is being set with open permissions: ugo+rw
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:46 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.info
Nov 07 02:52:46 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:46 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.info" returned: 0 in 0.266s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:46 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.567s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf" returned: 0 in 0.408s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:46 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf
Nov 07 02:52:46 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:46 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-85664c24-bc0f-48a6-8bbb-784c9c640ee0 tempest-ProjectMemberTests-1264181528 None] Create snapshot completed successfully
Nov 07 02:52:46 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003.7b552df7-0e37-4e04-84d1-844c6b982ccf" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-7b552df7-0e37-4e04-84d1-844c6b982ccf" released by "_delete_snapshot" :: held 1.853s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:46 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003" released by "delete_snapshot" :: held 1.890s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Created reservations ['dd33ca4a-77f9-49f5-a98a-40fdd3cc448e', 'b85c1c46-ca51-4085-83b0-fffc14744249', '24c3e375-ebe9-4ebd-95f7-4c7a02310dc6', '913baa56-7ed6-4bd5-8d0e-716e1bb3a7cb'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Delete snapshot completed successfully.
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ed84309b-7883-4851-a1da-8795abb8d820 tempest-ProjectReaderTests-344415422 None] Lock "cinder-7b552df7-0e37-4e04-84d1-844c6b982ccf-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Deleting offline snapshot 36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 of volume d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] snapshot_file for this snap is: volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[961c4cd5-52c2-4273-8ac1-2beee4a2ec98]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Lock "cinder-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93f90bd-28ae-4a90-ada7-7d72097882a8]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack sudo[107428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9
Nov 07 02:52:47 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:47 devstack sudo[107430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003
Nov 07 02:52:47 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:47 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9" returned: 0 in 0.497s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a35245b-21fd-421e-b121-e6c789d7fc4a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003" returned: 0 in 0.498s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003
Nov 07 02:52:47 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:47 devstack sudo[107438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d
Nov 07 02:52:47 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:48 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003" returned: 0 in 0.376s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003" released by "delete_volume" :: held 0.971s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:48 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d" returned: 0 in 0.555s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:48 devstack sudo[107448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9
Nov 07 02:52:48 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Created reservations ['cbb21c63-82b9-4250-9d17-ff8b29cb86f3', 'c2e4082b-dbea-46dc-aaee-8f6468d84701', '6fcecc28-ffb5-4f4f-a1fb-536c7dd4fac4', '85940a58-1c5f-4a37-9f83-3c3bac83736d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:48 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:48 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b61169f1-55e6-4f18-8e06-eda51d0c469a tempest-ProjectAdminTests-1348158723 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7832832336426, 'free_capacity_gb': 1773.7832832336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87087) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 07 02:52:48 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.327s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Deleted volume successfully.
Nov 07 02:52:48 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9" returned: 0 in 0.517s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-235226b8-48a5-42c7-ae86-a3eba82b93b6 tempest-ProjectReaderTests-344415422 None] Lock "cinder-1eaf28a8-ecdf-4b55-ba89-a6107f4d3003-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:48 devstack sudo[107458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9
Nov 07 02:52:48 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:49 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d.36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9" released by "_delete_snapshot" :: held 2.081s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d" released by "delete_snapshot" :: held 2.135s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:49 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Created reservations ['39716c03-774a-4b51-a92c-278dbe21b2a4', 'cd80aa61-9c44-498c-9bde-dc88d8cba17d', 'd2b4b7d0-5aac-49b8-82b4-5e6ba875a823', 'e5af2888-7ffc-4ea8-b9f2-076ec4de3c1c'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:49 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Delete snapshot completed successfully.
Nov 07 02:52:49 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-8fa17f7c-f9c8-4554-bfb9-76060bd52bbc tempest-ProjectMemberTests-1264181528 None] Lock "cinder-36ae9a4c-f7e4-4e69-a241-ebbbb11a5fe9-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Flow 'volume_create_manager' (15ae0509-d0c1-4177-b330-ba39d3d6abf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c7cd07-41f1-4a03-b1fe-78c26095965e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c7cd07-41f1-4a03-b1fe-78c26095965e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899098923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=587652b5-45ea-4f31-818f-11d0aec85148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f8124e1a01410db31a360d3a075b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:50Z,use_quota=True,user_id='e45f050e2f544e2595ba850c10530d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42dd6a7a-4853-48ef-bedd-4db0b53f8b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42dd6a7a-4853-48ef-bedd-4db0b53f8b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f0b672-bab1-4a0b-a1bf-8e68a8a785c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f0b672-bab1-4a0b-a1bf-8e68a8a785c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '587652b5-45ea-4f31-818f-11d0aec85148', 'volume_name': 'volume-587652b5-45ea-4f31-818f-11d0aec85148', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195ea939-32c0-4aa6-a366-a8f616d6b44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195ea939-32c0-4aa6-a366-a8f616d6b44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07fd67b0-07bb-403f-8433-5436f33ad48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:50 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Volume 587652b5-45ea-4f31-818f-11d0aec85148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-587652b5-45ea-4f31-818f-11d0aec85148', 'volume_size': 1}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899098923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=587652b5-45ea-4f31-818f-11d0aec85148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f8124e1a01410db31a360d3a075b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:50Z,use_quota=True,user_id='e45f050e2f544e2595ba850c10530d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Creating volume 587652b5-45ea-4f31-818f-11d0aec85148 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:50 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:50 devstack sudo[107461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148 1073741824
Nov 07 02:52:50 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[21890f5a-3acc-49b8-b8c9-5b14450958e3]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:50 devstack sudo[107467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d
Nov 07 02:52:50 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148 1073741824" returned: 0 in 0.628s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:50 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:50 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148
Nov 07 02:52:50 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:51 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d" returned: 0 in 0.596s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:51 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148" returned: 0 in 0.328s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07fd67b0-07bb-403f-8433-5436f33ad48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-587652b5-45ea-4f31-818f-11d0aec85148', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:51 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9753ee6d-ee67-46d1-a71f-b8c34f497086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:51 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:51 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Volume volume-587652b5-45ea-4f31-818f-11d0aec85148 (587652b5-45ea-4f31-818f-11d0aec85148): created successfully
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9753ee6d-ee67-46d1-a71f-b8c34f497086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Flow 'volume_create_manager' (15ae0509-d0c1-4177-b330-ba39d3d6abf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-37ca48c0-130b-439d-ae5d-ab47377fb342 tempest-ProjectReaderTests-344415422 None] Created volume successfully.
Nov 07 02:52:51 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d" returned: 0 in 0.299s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d" released by "delete_volume" :: held 0.984s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Created reservations ['7fac130f-9496-4dd1-87d3-86d10a1cefbf', 'b61c8508-6746-4d2d-b911-88e80ed3f4c9', 'f5311e1b-6878-4da8-a27a-036d8879bdbb', '9d8ab25e-d8a6-45ee-b5ec-886413646f2f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:51 devstack sudo[107479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:51 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:51 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.294s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:51 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Deleted volume successfully.
Nov 07 02:52:51 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1a06b006-5f6a-48d4-8933-b6a8b2954758 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-d983f6ff-a28e-44bb-a99e-b5e7ae2e0d9d-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] Creating offline snapshot 362a36c1-7b41-4a48-b149-ef57bbdf387d of volume 587652b5-45ea-4f31-818f-11d0aec85148 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:52 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[777d2f48-1e25-41f3-8d3d-dce6a8eb3897]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:52 devstack sudo[107482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148
Nov 07 02:52:52 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:52 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148" returned: 0 in 0.491s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:52 devstack sudo[107487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d 1G
Nov 07 02:52:52 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=247,cinder:UPDATE=312,cinder:INSERT=82,cinder:DELETE=29 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=359,cinder:SELECT=253,cinder:INSERT=98,cinder:DELETE=30 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (cc0f223e-50f0-4053-ab06-5ab7e59c7098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527541a9-a39e-4b80-9217-c226ee88dc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527541a9-a39e-4b80-9217-c226ee88dc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060957986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6630bc04-9190-45be-a183-e2b5569461b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:53Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d6fe19-0c46-46f2-b336-8628daa21a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d6fe19-0c46-46f2-b336-8628daa21a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68233173-063b-409a-96cb-07dc8d212b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68233173-063b-409a-96cb-07dc8d212b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6630bc04-9190-45be-a183-e2b5569461b0', 'volume_name': 'volume-6630bc04-9190-45be-a183-e2b5569461b0', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babf67b5-2ce4-4933-9782-7e14e5e5ab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babf67b5-2ce4-4933-9782-7e14e5e5ab84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0a8155-1e30-42c6-9c7f-d76f5ee24e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:53 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Volume 6630bc04-9190-45be-a183-e2b5569461b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6630bc04-9190-45be-a183-e2b5569461b0', 'volume_size': 1}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:53 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d 1G" returned: 0 in 0.663s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-587652b5-45ea-4f31-818f-11d0aec85148 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:53 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:53 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:53 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-587652b5-45ea-4f31-818f-11d0aec85148 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d
Nov 07 02:52:53 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:53 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.283s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:52:53 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-587652b5-45ea-4f31-818f-11d0aec85148 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d" returned: 0 in 0.371s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:53 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d is being set with open permissions: ugo+rw
Nov 07 02:52:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:53 devstack sudo[107501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d
Nov 07 02:52:53 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:54 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d" returned: 0 in 0.303s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:54 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.info
Nov 07 02:52:54 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:54 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.info" returned: 0 in 0.287s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:54 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.info is being set with open permissions: ugo+rw
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:54 devstack sudo[107507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.info
Nov 07 02:52:54 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:54 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.info" returned: 0 in 0.282s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.406s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060957986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6630bc04-9190-45be-a183-e2b5569461b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:53Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Creating volume 6630bc04-9190-45be-a183-e2b5569461b0 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:54 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:54 devstack sudo[107510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0 1073741824
Nov 07 02:52:54 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-391075e5-5020-46f8-8e47-49ac467c4a14 tempest-ProjectReaderTests-344415422 None] Create snapshot completed successfully
Nov 07 02:52:55 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0 1073741824" returned: 0 in 0.527s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:55 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0
Nov 07 02:52:55 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-362a36c1-7b41-4a48-b149-ef57bbdf387d-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Lock "cinder-362a36c1-7b41-4a48-b149-ef57bbdf387d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-587652b5-45ea-4f31-818f-11d0aec85148" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-587652b5-45ea-4f31-818f-11d0aec85148" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-362a36c1-7b41-4a48-b149-ef57bbdf387d" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-362a36c1-7b41-4a48-b149-ef57bbdf387d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Deleting offline snapshot 362a36c1-7b41-4a48-b149-ef57bbdf387d of volume 587652b5-45ea-4f31-818f-11d0aec85148 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] snapshot_file for this snap is: volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a0fe8-8906-4ab7-b078-23dea2169702]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:55 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0" returned: 0 in 0.318s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0a8155-1e30-42c6-9c7f-d76f5ee24e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6630bc04-9190-45be-a183-e2b5569461b0', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d07c8b-60f2-49a1-8aa6-d06d20c5e965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:55 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Volume volume-6630bc04-9190-45be-a183-e2b5569461b0 (6630bc04-9190-45be-a183-e2b5569461b0): created successfully
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d07c8b-60f2-49a1-8aa6-d06d20c5e965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:55 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (cc0f223e-50f0-4053-ab06-5ab7e59c7098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:55 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d43a251c-3b8b-4ccd-bfb5-f7bddaf612c9 tempest-ProjectMemberTests-1264181528 None] Created volume successfully.
Nov 07 02:52:55 devstack sudo[107519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d
Nov 07 02:52:55 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:56 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d" returned: 0 in 0.451s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-587652b5-45ea-4f31-818f-11d0aec85148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[82692947-94bb-4568-9587-6fafaa496ed9]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:56 devstack sudo[107524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148
Nov 07 02:52:56 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:56 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148" returned: 0 in 0.517s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:56 devstack sudo[107529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d
Nov 07 02:52:56 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:56 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] Creating offline snapshot 19e558c2-0ba4-432b-9a82-22eb4a1e2a12 of volume 6630bc04-9190-45be-a183-e2b5569461b0 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:56 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[916837c8-ea35-45e7-8592-820fab840893]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:56 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0
Nov 07 02:52:56 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:57 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d" returned: 0 in 0.461s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:57 devstack sudo[107538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d
Nov 07 02:52:57 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:57 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0" returned: 0 in 0.464s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:57 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12 1G
Nov 07 02:52:57 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:57 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148.362a36c1-7b41-4a48-b149-ef57bbdf387d" returned: 0 in 0.334s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-362a36c1-7b41-4a48-b149-ef57bbdf387d" released by "_delete_snapshot" :: held 1.901s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-587652b5-45ea-4f31-818f-11d0aec85148" released by "delete_snapshot" :: held 1.932s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Flow 'volume_create_manager' (5bbccbe5-8c81-4b13-adee-d605ecf17d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d546235-3843-4d11-ba0c-4c30357ef825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Created reservations ['438f7bcc-812a-4b0e-9eeb-54f17fa414c0', 'bb1c782f-af22-490b-afae-eb22d9adcef0', '3a312a6c-9cdd-4568-a0aa-d969075e27fe', '34ad3585-7d9e-428a-975f-cf531882c8db'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d546235-3843-4d11-ba0c-4c30357ef825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223611801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d95790ac-1e86-452d-978a-341bc0ae2a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58df76a00d74c7caeea6ae69ffce3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:58Z,use_quota=True,user_id='1f0e53ecdd3e46d78e1c2461e3d189e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f9de85-5026-4c41-842e-02e2b20d9b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f9de85-5026-4c41-842e-02e2b20d9b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83e8efd-698c-4730-bd54-e0f34ec04aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83e8efd-698c-4730-bd54-e0f34ec04aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd95790ac-1e86-452d-978a-341bc0ae2a12', 'volume_name': 'volume-d95790ac-1e86-452d-978a-341bc0ae2a12', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8778562-c492-4529-9f17-31a156fc2ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8778562-c492-4529-9f17-31a156fc2ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f328968-cee4-42ac-8b9a-687c7acf4533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:57 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Volume d95790ac-1e86-452d-978a-341bc0ae2a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d95790ac-1e86-452d-978a-341bc0ae2a12', 'volume_size': 1}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:57 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Delete snapshot completed successfully.
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ffbb9d03-c1c1-4bbc-b698-ca6482bd4b4e tempest-ProjectReaderTests-344415422 None] Lock "cinder-362a36c1-7b41-4a48-b149-ef57bbdf387d-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:57 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12 1G" returned: 0 in 0.598s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:57 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6630bc04-9190-45be-a183-e2b5569461b0 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:57 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6630bc04-9190-45be-a183-e2b5569461b0 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12
Nov 07 02:52:57 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:58 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6630bc04-9190-45be-a183-e2b5569461b0 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12" returned: 0 in 0.317s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:58 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12 is being set with open permissions: ugo+rw
Nov 07 02:52:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:58 devstack sudo[107555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12
Nov 07 02:52:58 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:58 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12" returned: 0 in 0.245s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:58 devstack sudo[107559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.info
Nov 07 02:52:58 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:58 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.info" returned: 0 in 0.270s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:58 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.info is being set with open permissions: ugo+rw
Nov 07 02:52:58 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:58 devstack sudo[107562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.info
Nov 07 02:52:58 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-587652b5-45ea-4f31-818f-11d0aec85148-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Lock "cinder-587652b5-45ea-4f31-818f-11d0aec85148-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-587652b5-45ea-4f31-818f-11d0aec85148" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:58 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-587652b5-45ea-4f31-818f-11d0aec85148" acquired by "delete_volume" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f69f8db-4b49-4f9e-94c6-1a126fb33cb4]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:59 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.info" returned: 0 in 0.309s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.303s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.296s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223611801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d95790ac-1e86-452d-978a-341bc0ae2a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58df76a00d74c7caeea6ae69ffce3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:58Z,use_quota=True,user_id='1f0e53ecdd3e46d78e1c2461e3d189e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Creating volume d95790ac-1e86-452d-978a-341bc0ae2a12 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:59 devstack sudo[107566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12 1073741824
Nov 07 02:52:59 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4d08380a-354f-4ba7-a5d6-6bd903c8a7b9 tempest-ProjectMemberTests-1264181528 None] Create snapshot completed successfully
Nov 07 02:52:59 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148
Nov 07 02:52:59 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:59 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:59 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148
Nov 07 02:52:59 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:59 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12 1073741824" returned: 0 in 0.450s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:59 devstack sudo[107579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12
Nov 07 02:52:59 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:59 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-587652b5-45ea-4f31-818f-11d0aec85148" returned: 0 in 0.267s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-587652b5-45ea-4f31-818f-11d0aec85148" released by "delete_volume" :: held 0.724s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Created reservations ['65124911-4b6e-4b4b-93cf-d58e9c3c2b98', 'fbeaadb9-b2c7-45bc-89d9-380ae6c310f1', 'a92f88ad-e3eb-43e9-adb9-d2d06a24f7db', 'f32713dc-3331-40b2-af9b-fc7f29d7419a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:59 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12" returned: 0 in 0.290s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:59 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:52:59 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f328968-cee4-42ac-8b9a-687c7acf4533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d95790ac-1e86-452d-978a-341bc0ae2a12', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa975b1a-6956-44c4-94e3-7b9fea07c410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Volume volume-d95790ac-1e86-452d-978a-341bc0ae2a12 (d95790ac-1e86-452d-978a-341bc0ae2a12): created successfully
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa975b1a-6956-44c4-94e3-7b9fea07c410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Flow 'volume_create_manager' (5bbccbe5-8c81-4b13-adee-d605ecf17d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:59 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-52500ba8-6da7-4854-97bf-cfe4af9fdefd tempest-ProjectReaderTests-1877153596 None] Created volume successfully.
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-19e558c2-0ba4-432b-9a82-22eb4a1e2a12-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-19e558c2-0ba4-432b-9a82-22eb4a1e2a12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:59 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-6630bc04-9190-45be-a183-e2b5569461b0" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-6630bc04-9190-45be-a183-e2b5569461b0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-19e558c2-0ba4-432b-9a82-22eb4a1e2a12" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-19e558c2-0ba4-432b-9a82-22eb4a1e2a12" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Deleting offline snapshot 19e558c2-0ba4-432b-9a82-22eb4a1e2a12 of volume 6630bc04-9190-45be-a183-e2b5569461b0 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] snapshot_file for this snap is: volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6939f2-25b8-4e0b-87e1-93ed2931ee09]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:00 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.333s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Deleted volume successfully.
Nov 07 02:53:00 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12
Nov 07 02:53:00 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-72a47f3b-e673-49fe-871f-0f634758e19c tempest-ProjectReaderTests-344415422 None] Lock "cinder-587652b5-45ea-4f31-818f-11d0aec85148-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:00 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12" returned: 0 in 0.435s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6630bc04-9190-45be-a183-e2b5569461b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0653d-e2ae-4559-93c5-5bf2a854ace1]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Flow 'volume_create_manager' (c19ee1d3-5665-47df-908c-76378084d51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3aa121-fb85-467e-932c-80657c11cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3aa121-fb85-467e-932c-80657c11cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1670442695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16dc9b4-e947-410e-a0bd-3d8954680ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f8124e1a01410db31a360d3a075b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:01Z,use_quota=True,user_id='e45f050e2f544e2595ba850c10530d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a38847-d636-46e4-93b5-706053f1016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:00 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0
Nov 07 02:53:00 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a38847-d636-46e4-93b5-706053f1016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a256db5-10de-4097-9c4f-191244002383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a256db5-10de-4097-9c4f-191244002383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16dc9b4-e947-410e-a0bd-3d8954680ce3', 'volume_name': 'volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2f8804-9723-418c-aa97-22119028e94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2f8804-9723-418c-aa97-22119028e94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acbdbc4-2b67-48ab-9efd-8c69c74cf5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:00 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Volume b16dc9b4-e947-410e-a0bd-3d8954680ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3', 'volume_size': 1}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1670442695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16dc9b4-e947-410e-a0bd-3d8954680ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f8124e1a01410db31a360d3a075b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:01Z,use_quota=True,user_id='e45f050e2f544e2595ba850c10530d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Creating volume b16dc9b4-e947-410e-a0bd-3d8954680ce3 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:00 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:00 devstack sudo[107593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 1073741824
Nov 07 02:53:00 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Acquiring lock "cinder-d95790ac-1e86-452d-978a-341bc0ae2a12-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Lock "cinder-d95790ac-1e86-452d-978a-341bc0ae2a12-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:01 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0" returned: 0 in 0.533s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:01 devstack sudo[107600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12
Nov 07 02:53:01 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Acquiring lock "cinder-quobyte-d95790ac-1e86-452d-978a-341bc0ae2a12" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Lock "cinder-quobyte-d95790ac-1e86-452d-978a-341bc0ae2a12" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88b40c1-ebba-4ca9-8aa6-a12a5bb86304]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:01 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12
Nov 07 02:53:01 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:01 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 1073741824" returned: 0 in 0.555s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:01 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3
Nov 07 02:53:01 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:01 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12" returned: 0 in 0.388s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:01 devstack sudo[107612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12
Nov 07 02:53:01 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:01 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12" returned: 0 in 0.426s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:01 devstack sudo[107617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12
Nov 07 02:53:01 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:01 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3" returned: 0 in 0.270s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acbdbc4-2b67-48ab-9efd-8c69c74cf5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b702beb8-b898-4276-9772-1ada8fe2e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:01 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Volume volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 (b16dc9b4-e947-410e-a0bd-3d8954680ce3): created successfully
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b702beb8-b898-4276-9772-1ada8fe2e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Flow 'volume_create_manager' (c19ee1d3-5665-47df-908c-76378084d51b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-68be1863-be9d-40fd-8cd5-8166101c809e tempest-ProjectReaderTests-344415422 None] Created volume successfully.
Nov 07 02:53:01 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0.19e558c2-0ba4-432b-9a82-22eb4a1e2a12" returned: 0 in 0.273s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-19e558c2-0ba4-432b-9a82-22eb4a1e2a12" released by "_delete_snapshot" :: held 1.770s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-6630bc04-9190-45be-a183-e2b5569461b0" released by "delete_snapshot" :: held 1.799s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Created reservations ['c2404360-fa34-4d35-a2eb-c31cfbc18822', '4f77e007-7fdb-4e52-9429-d52f570e6849', '32f71ce2-3b3f-454c-92de-edf3df54203e', 'b5d07fe1-736c-4608-b879-e35acb8cb210'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:01 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-d95790ac-1e86-452d-978a-341bc0ae2a12" returned: 0 in 0.281s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Lock "cinder-quobyte-d95790ac-1e86-452d-978a-341bc0ae2a12" released by "delete_volume" :: held 0.756s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Delete snapshot completed successfully.
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3325626b-435c-4577-8be9-ff2512595ef3 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-19e558c2-0ba4-432b-9a82-22eb4a1e2a12-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:01 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Created reservations ['a56b1e48-bb68-44e3-ad54-1feed0549318', '4743e00b-7cb6-458e-8950-b94376b6b22b', '74ee6881-fa93-4b28-a503-776fd1f21ae0', 'c7ffb84a-2483-41b2-b887-a7a198b48888'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:02 devstack sudo[107621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:02 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-6630bc04-9190-45be-a183-e2b5569461b0-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-6630bc04-9190-45be-a183-e2b5569461b0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-6630bc04-9190-45be-a183-e2b5569461b0" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-6630bc04-9190-45be-a183-e2b5569461b0" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d869cfa-c8e9-4160-b24e-5fc6f95a4ca4]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:02 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.354s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Deleted volume successfully.
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4e75dd7f-ffb5-4297-8fef-5a2eec1cb6f3 tempest-ProjectReaderTests-1877153596 None] Lock "cinder-d95790ac-1e86-452d-978a-341bc0ae2a12-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:02 devstack sudo[107624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0
Nov 07 02:53:02 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:02 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0" returned: 0 in 0.475s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:02 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0
Nov 07 02:53:02 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Flow 'volume_create_manager' (4aa01751-4a38-4c0d-b41e-fa045091f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06572380-504f-4fdc-a593-f4c41f0f45b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06572380-504f-4fdc-a593-f4c41f0f45b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-724998571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c804fce-a084-468f-add6-e55b0a951a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58df76a00d74c7caeea6ae69ffce3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:03Z,use_quota=True,user_id='1f0e53ecdd3e46d78e1c2461e3d189e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6aa945-3700-4378-8297-9eb6e8deab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6aa945-3700-4378-8297-9eb6e8deab9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051b9f8e-30c5-4887-a3ac-fdcb202d9882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051b9f8e-30c5-4887-a3ac-fdcb202d9882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c804fce-a084-468f-add6-e55b0a951a9f', 'volume_name': 'volume-5c804fce-a084-468f-add6-e55b0a951a9f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6564d76a-c392-444f-af0a-60c0cce89811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6564d76a-c392-444f-af0a-60c0cce89811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd3d17a-c8d5-428e-bb50-53beaa0feb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:03 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Volume 5c804fce-a084-468f-add6-e55b0a951a9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c804fce-a084-468f-add6-e55b0a951a9f', 'volume_size': 1}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-724998571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c804fce-a084-468f-add6-e55b0a951a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58df76a00d74c7caeea6ae69ffce3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:03Z,use_quota=True,user_id='1f0e53ecdd3e46d78e1c2461e3d189e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Creating volume 5c804fce-a084-468f-add6-e55b0a951a9f {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:03 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:03 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f 1073741824
Nov 07 02:53:03 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:03 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-6630bc04-9190-45be-a183-e2b5569461b0" returned: 0 in 0.337s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-6630bc04-9190-45be-a183-e2b5569461b0" released by "delete_volume" :: held 0.921s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Created reservations ['75f79149-411e-4d50-86de-89daebd96ec2', 'd29c4d60-9574-474b-95cb-ca04aabe9a26', '9ea05f66-4072-4e6d-8f3b-c54199ce6581', 'bfb5de31-b6ca-4eef-8db5-f37ba95ca904'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:03 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:03 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:03 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f 1073741824" returned: 0 in 0.487s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:03 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.258s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Deleted volume successfully.
Nov 07 02:53:03 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f
Nov 07 02:53:03 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-1c957a35-b689-4669-b9cd-6e69eb5f8627 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-6630bc04-9190-45be-a183-e2b5569461b0-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:03 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f" returned: 0 in 0.261s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.653s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd3d17a-c8d5-428e-bb50-53beaa0feb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c804fce-a084-468f-add6-e55b0a951a9f', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699ddc2a-fac0-47cb-93aa-c49285b230ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] Creating offline snapshot 681446a9-9f68-4a5f-aeab-4c72f2910146 of volume b16dc9b4-e947-410e-a0bd-3d8954680ce3 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:03 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Volume volume-5c804fce-a084-468f-add6-e55b0a951a9f (5c804fce-a084-468f-add6-e55b0a951a9f): created successfully
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699ddc2a-fac0-47cb-93aa-c49285b230ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Flow 'volume_create_manager' (4aa01751-4a38-4c0d-b41e-fa045091f88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87bc440-eefb-4c6c-bdb8-00b92ab92e1d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:03 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-b3fd7bcb-98a5-4ec0-9420-9b6ef305aeae tempest-ProjectReaderTests-1877153596 None] Created volume successfully.
Nov 07 02:53:04 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3
Nov 07 02:53:04 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:04 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3" returned: 0 in 0.380s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:04 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146 1G
Nov 07 02:53:04 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:04 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146 1G" returned: 0 in 0.474s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:04 devstack sudo[107655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146
Nov 07 02:53:04 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:04 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (3665b9e7-1a5d-46aa-a23e-5a7a81b2be8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83ef90c-7085-459a-bfac-90c43acb2bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83ef90c-7085-459a-bfac-90c43acb2bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989150081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee1762d-441c-4638-858f-69af033b8a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:05Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e63954-338f-4bd3-9a77-4997528ffdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e63954-338f-4bd3-9a77-4997528ffdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e03890-4c34-4636-a902-d859a395a8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e03890-4c34-4636-a902-d859a395a8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee1762d-441c-4638-858f-69af033b8a4d', 'volume_name': 'volume-eee1762d-441c-4638-858f-69af033b8a4d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f870cf-82f8-4687-bfa8-63870f0b288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f870cf-82f8-4687-bfa8-63870f0b288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8191d5e-02e6-4117-b43a-61e81345b26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:05 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Volume eee1762d-441c-4638-858f-69af033b8a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee1762d-441c-4638-858f-69af033b8a4d', 'volume_size': 1}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Acquiring lock "cinder-5c804fce-a084-468f-add6-e55b0a951a9f-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Lock "cinder-5c804fce-a084-468f-add6-e55b0a951a9f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Acquiring lock "cinder-quobyte-5c804fce-a084-468f-add6-e55b0a951a9f" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Lock "cinder-quobyte-5c804fce-a084-468f-add6-e55b0a951a9f" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:05 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146" returned: 0 in 0.409s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:05 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146 is being set with open permissions: ugo+rw
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898abbf-34d4-43aa-97c7-27693086f03e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:05 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146
Nov 07 02:53:05 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:05 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f
Nov 07 02:53:05 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:05 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146" returned: 0 in 0.265s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:05 devstack sudo[107666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.info
Nov 07 02:53:05 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:05 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f" returned: 0 in 0.438s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:05 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f
Nov 07 02:53:05 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:05 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.info" returned: 0 in 0.309s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:05 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.info is being set with open permissions: ugo+rw
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:05 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.info
Nov 07 02:53:05 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:05 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c804fce-a084-468f-add6-e55b0a951a9f" returned: 0 in 0.309s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:05 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Lock "cinder-quobyte-5c804fce-a084-468f-add6-e55b0a951a9f" released by "delete_volume" :: held 0.801s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Created reservations ['c08ce417-57b6-4fb4-a60d-4277425880b0', 'adf9e208-edaf-400f-a15d-1521abb5ed44', '39c7a266-27a9-4652-9e16-ddabb02ddfd2', 'a67b920a-3f32-4cc0-96b1-47b6b879374f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:06 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.info" returned: 0 in 0.286s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.039s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989150081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee1762d-441c-4638-858f-69af033b8a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:05Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Creating volume eee1762d-441c-4638-858f-69af033b8a4d {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:06 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:06 devstack sudo[107678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d 1073741824
Nov 07 02:53:06 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6088be87-ddbe-4897-9563-f99431a10882 tempest-ProjectReaderTests-344415422 None] Create snapshot completed successfully
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:06 devstack sudo[107680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:06 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:06 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.310s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:06 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Deleted volume successfully.
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-564fa0cb-3144-4e60-980a-593723ff6ceb tempest-ProjectReaderTests-1877153596 None] Lock "cinder-5c804fce-a084-468f-add6-e55b0a951a9f-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:06 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d 1073741824" returned: 0 in 0.595s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:06 devstack sudo[107687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:06 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Flow 'volume_create_manager' (0210ec57-374e-4505-af7f-1388b3ee2e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cd787e-074a-4596-9012-9213b9132071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cd787e-074a-4596-9012-9213b9132071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834924033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9145e7-9c24-4a9d-9586-adb8c69793d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58df76a00d74c7caeea6ae69ffce3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:07Z,use_quota=True,user_id='1f0e53ecdd3e46d78e1c2461e3d189e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62c751f-716f-4631-bf66-243afabebcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62c751f-716f-4631-bf66-243afabebcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091a3985-fd15-4406-a7ae-8704c614fd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091a3985-fd15-4406-a7ae-8704c614fd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f9145e7-9c24-4a9d-9586-adb8c69793d6', 'volume_name': 'volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98955671-c60a-4f25-a6fc-24a3e04804c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98955671-c60a-4f25-a6fc-24a3e04804c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba92518-5e4c-471e-a524-673fb2fa755c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:06 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Volume 3f9145e7-9c24-4a9d-9586-adb8c69793d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6', 'volume_size': 1}
Nov 07 02:53:06 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:07 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d" returned: 0 in 0.271s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834924033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9145e7-9c24-4a9d-9586-adb8c69793d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58df76a00d74c7caeea6ae69ffce3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:07Z,use_quota=True,user_id='1f0e53ecdd3e46d78e1c2461e3d189e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Creating volume 3f9145e7-9c24-4a9d-9586-adb8c69793d6 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:07 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8191d5e-02e6-4117-b43a-61e81345b26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee1762d-441c-4638-858f-69af033b8a4d', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:07 devstack sudo[107690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6 1073741824
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657cc808-0f24-4f7b-9519-0e0456827e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:07 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Volume volume-eee1762d-441c-4638-858f-69af033b8a4d (eee1762d-441c-4638-858f-69af033b8a4d): created successfully
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657cc808-0f24-4f7b-9519-0e0456827e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (3665b9e7-1a5d-46aa-a23e-5a7a81b2be8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5c5a0bb2-6993-468e-a54c-139dcd0a5745 tempest-ProjectMemberTests-1264181528 None] Created volume successfully.
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-681446a9-9f68-4a5f-aeab-4c72f2910146-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Lock "cinder-681446a9-9f68-4a5f-aeab-4c72f2910146-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-b16dc9b4-e947-410e-a0bd-3d8954680ce3" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-b16dc9b4-e947-410e-a0bd-3d8954680ce3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-681446a9-9f68-4a5f-aeab-4c72f2910146" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-681446a9-9f68-4a5f-aeab-4c72f2910146" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Deleting offline snapshot 681446a9-9f68-4a5f-aeab-4c72f2910146 of volume b16dc9b4-e947-410e-a0bd-3d8954680ce3 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] snapshot_file for this snap is: volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a025371-624a-48e6-ba0e-fb57a82095b5]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:07 devstack sudo[107695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146
Nov 07 02:53:07 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:07 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6 1073741824" returned: 0 in 0.527s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:07 devstack sudo[107698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6
Nov 07 02:53:07 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:07 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146" returned: 0 in 0.435s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:07 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6" returned: 0 in 0.285s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc87d861-9846-43f7-bdbc-1578e6d5ee49]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba92518-5e4c-471e-a524-673fb2fa755c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef34da9b-7239-4c54-bf13-36ac2fe2f22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:07 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Volume volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6 (3f9145e7-9c24-4a9d-9586-adb8c69793d6): created successfully
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef34da9b-7239-4c54-bf13-36ac2fe2f22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:07 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Flow 'volume_create_manager' (0210ec57-374e-4505-af7f-1388b3ee2e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:07 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3ee35bac-5c44-4b26-b31e-cc8dc9462c05 tempest-ProjectReaderTests-1877153596 None] Created volume successfully.
Nov 07 02:53:08 devstack sudo[107704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3
Nov 07 02:53:08 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] Creating offline snapshot ab1b67cf-ece0-459d-8027-a99fda727f2e of volume eee1762d-441c-4638-858f-69af033b8a4d {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:08 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3" returned: 0 in 0.477s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eec4725-39f4-4d8c-9113-5d4860556055]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:08 devstack sudo[107710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146
Nov 07 02:53:08 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:08 devstack sudo[107711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d
Nov 07 02:53:08 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:08 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146" returned: 0 in 0.424s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:08 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146
Nov 07 02:53:08 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:08 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d" returned: 0 in 0.467s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:08 devstack sudo[107722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e 1G
Nov 07 02:53:08 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:08 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Acquiring lock "cinder-3f9145e7-9c24-4a9d-9586-adb8c69793d6-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Lock "cinder-3f9145e7-9c24-4a9d-9586-adb8c69793d6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Acquiring lock "cinder-quobyte-3f9145e7-9c24-4a9d-9586-adb8c69793d6" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Lock "cinder-quobyte-3f9145e7-9c24-4a9d-9586-adb8c69793d6" acquired by "delete_volume" :: waited 0.027s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe716561-48b9-4b95-88b7-7fe5b7973cc0]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:09 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3.681446a9-9f68-4a5f-aeab-4c72f2910146" returned: 0 in 0.354s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-681446a9-9f68-4a5f-aeab-4c72f2910146" released by "_delete_snapshot" :: held 1.831s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-b16dc9b4-e947-410e-a0bd-3d8954680ce3" released by "delete_snapshot" :: held 1.862s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:09 devstack sudo[107725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6
Nov 07 02:53:09 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Created reservations ['fcbf540a-2c48-4279-9bb0-1aa29ad95629', 'e11701ba-6a76-4ea8-84ae-376ca763b3bf', 'ba364076-87a2-402a-9da0-0ccc08a231f9', '11509c8c-3702-4b54-9110-00ab9c417291'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:09 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Delete snapshot completed successfully.
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-518ea5c9-536c-4322-89af-fc94579a48d2 tempest-ProjectReaderTests-344415422 None] Lock "cinder-681446a9-9f68-4a5f-aeab-4c72f2910146-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-b16dc9b4-e947-410e-a0bd-3d8954680ce3-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:09 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e 1G" returned: 0 in 0.670s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eee1762d-441c-4638-858f-69af033b8a4d -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Lock "cinder-b16dc9b4-e947-410e-a0bd-3d8954680ce3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:09 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eee1762d-441c-4638-858f-69af033b8a4d -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e
Nov 07 02:53:09 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-b16dc9b4-e947-410e-a0bd-3d8954680ce3" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-b16dc9b4-e947-410e-a0bd-3d8954680ce3" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:09 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6" returned: 0 in 0.528s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[26417817-d51f-48e4-822d-4cc410c43fdf]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:09 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6
Nov 07 02:53:09 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:09 devstack sudo[107736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3
Nov 07 02:53:09 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:09 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eee1762d-441c-4638-858f-69af033b8a4d -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e" returned: 0 in 0.383s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:09 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e is being set with open permissions: ugo+rw
Nov 07 02:53:09 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:09 devstack sudo[107744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e
Nov 07 02:53:09 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:09 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-3f9145e7-9c24-4a9d-9586-adb8c69793d6" returned: 0 in 0.313s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Lock "cinder-quobyte-3f9145e7-9c24-4a9d-9586-adb8c69793d6" released by "delete_volume" :: held 0.900s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Created reservations ['ecf46d0c-21e9-4e3d-97d7-fc4c47af35a7', '4f5b6241-17b6-4a98-ace0-2a76a239ab5e', '83b52e64-5b45-4c6c-9154-f5d2fbb2c1b0', 'f8da74da-219d-4460-8139-443151317f8a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:10 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3" returned: 0 in 0.478s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:10 devstack sudo[107749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3
Nov 07 02:53:10 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:10 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e" returned: 0 in 0.313s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:10 devstack sudo[107752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:10 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:10 devstack sudo[107754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.info
Nov 07 02:53:10 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:10 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b16dc9b4-e947-410e-a0bd-3d8954680ce3" returned: 0 in 0.348s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-b16dc9b4-e947-410e-a0bd-3d8954680ce3" released by "delete_volume" :: held 0.912s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:10 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.345s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Deleted volume successfully.
Nov 07 02:53:10 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.info" returned: 0 in 0.295s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:10 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.info is being set with open permissions: ugo+rw
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:10 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.info
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68afc44b-8541-493c-87f3-f451e8605eee tempest-ProjectReaderTests-1877153596 None] Lock "cinder-3f9145e7-9c24-4a9d-9586-adb8c69793d6-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:10 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Created reservations ['eaec6c38-321e-4a56-9367-b325b880d33e', '3fcb23ce-1f48-43d1-9d8a-c007a6be1c61', '2a50b222-e9ba-425d-9cc9-39a63ffac54f', '09416ac2-d533-42ba-a35a-1a8129955b02'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:10 devstack sudo[107762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:10 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:10 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.info" returned: 0 in 0.312s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:10 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:10 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7d31ba8f-1afc-4c15-b62b-a011c47ba753 tempest-ProjectMemberTests-1264181528 None] Create snapshot completed successfully
Nov 07 02:53:11 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.308s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:11 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Deleted volume successfully.
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-451f1402-9581-49f5-8b76-36e84d1d7db4 tempest-ProjectReaderTests-344415422 None] Lock "cinder-b16dc9b4-e947-410e-a0bd-3d8954680ce3-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Flow 'volume_create_manager' (80d5eb43-0c0b-4d1d-bf05-2f7e3da2d0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a03de1-1fdc-4bbf-9866-e5d43dbd9946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a03de1-1fdc-4bbf-9866-e5d43dbd9946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2023141019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066852ef-da13-429d-926f-dcc41c32bedd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f8124e1a01410db31a360d3a075b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:11Z,use_quota=True,user_id='e45f050e2f544e2595ba850c10530d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b010701-6188-4a9e-b7ee-0943f84f9468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b010701-6188-4a9e-b7ee-0943f84f9468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb85d96-7c7a-4f53-8443-e22bf1849e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb85d96-7c7a-4f53-8443-e22bf1849e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066852ef-da13-429d-926f-dcc41c32bedd', 'volume_name': 'volume-066852ef-da13-429d-926f-dcc41c32bedd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f5abc7-db80-4195-ae37-a51ce5566d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f5abc7-db80-4195-ae37-a51ce5566d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a84a8a-5e73-4dad-8d41-2119af13daee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Volume 066852ef-da13-429d-926f-dcc41c32bedd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066852ef-da13-429d-926f-dcc41c32bedd', 'volume_size': 1}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2023141019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066852ef-da13-429d-926f-dcc41c32bedd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f8124e1a01410db31a360d3a075b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:11Z,use_quota=True,user_id='e45f050e2f544e2595ba850c10530d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Creating volume 066852ef-da13-429d-926f-dcc41c32bedd {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:11 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:11 devstack sudo[107766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd 1073741824
Nov 07 02:53:11 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-ab1b67cf-ece0-459d-8027-a99fda727f2e-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-ab1b67cf-ece0-459d-8027-a99fda727f2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-eee1762d-441c-4638-858f-69af033b8a4d" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-eee1762d-441c-4638-858f-69af033b8a4d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-ab1b67cf-ece0-459d-8027-a99fda727f2e" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-ab1b67cf-ece0-459d-8027-a99fda727f2e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Deleting offline snapshot ab1b67cf-ece0-459d-8027-a99fda727f2e of volume eee1762d-441c-4638-858f-69af033b8a4d {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] snapshot_file for this snap is: volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5fb9b9-9eda-47f8-b0cc-6e79e83fcbc6]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Flow 'volume_create_manager' (f7dcb609-ae59-4dc5-a5e3-438b2c6c4bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556ae35a-d339-4686-b8d4-a357f38fbc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:11 devstack sudo[107768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e
Nov 07 02:53:11 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556ae35a-d339-4686-b8d4-a357f38fbc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493109059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c10f01b-38ff-4111-8649-c26694b22c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58df76a00d74c7caeea6ae69ffce3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:12Z,use_quota=True,user_id='1f0e53ecdd3e46d78e1c2461e3d189e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727355c5-ae1b-46cd-a7a0-d381a8c4cca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727355c5-ae1b-46cd-a7a0-d381a8c4cca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d826fef-d2b9-429f-953c-d9f9c10291a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d826fef-d2b9-429f-953c-d9f9c10291a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c10f01b-38ff-4111-8649-c26694b22c94', 'volume_name': 'volume-5c10f01b-38ff-4111-8649-c26694b22c94', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e375ac-c78a-47e0-be7d-5952e7c9da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e375ac-c78a-47e0-be7d-5952e7c9da66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cf946c-79bc-4e37-b7ca-06bbb7f2fb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:11 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Volume 5c10f01b-38ff-4111-8649-c26694b22c94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c10f01b-38ff-4111-8649-c26694b22c94', 'volume_size': 1}
Nov 07 02:53:11 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:12 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd 1073741824" returned: 0 in 0.623s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:12 devstack sudo[107775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd
Nov 07 02:53:12 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:12 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e" returned: 0 in 0.474s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eee1762d-441c-4638-858f-69af033b8a4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0a7f91-d245-4c38-8797-505d42109f4d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:12 devstack sudo[107780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d
Nov 07 02:53:12 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:12 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd" returned: 0 in 0.269s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493109059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c10f01b-38ff-4111-8649-c26694b22c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58df76a00d74c7caeea6ae69ffce3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:12Z,use_quota=True,user_id='1f0e53ecdd3e46d78e1c2461e3d189e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Creating volume 5c10f01b-38ff-4111-8649-c26694b22c94 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:12 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a84a8a-5e73-4dad-8d41-2119af13daee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066852ef-da13-429d-926f-dcc41c32bedd', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cd13fc-9745-40e6-add8-799435cc379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:12 devstack sudo[107783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94 1073741824
Nov 07 02:53:12 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:12 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Volume volume-066852ef-da13-429d-926f-dcc41c32bedd (066852ef-da13-429d-926f-dcc41c32bedd): created successfully
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cd13fc-9745-40e6-add8-799435cc379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Flow 'volume_create_manager' (80d5eb43-0c0b-4d1d-bf05-2f7e3da2d0d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:12 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7860f1b5-8544-4932-9dcd-28d02035b363 tempest-ProjectReaderTests-344415422 None] Created volume successfully.
Nov 07 02:53:12 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d" returned: 0 in 0.417s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:12 devstack sudo[107790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e
Nov 07 02:53:12 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:12 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94 1073741824" returned: 0 in 0.519s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:12 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:12 devstack sudo[107797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94
Nov 07 02:53:12 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:13 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e" returned: 0 in 0.414s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:13 devstack sudo[107800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e
Nov 07 02:53:13 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:13 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94" returned: 0 in 0.283s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cf946c-79bc-4e37-b7ca-06bbb7f2fb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c10f01b-38ff-4111-8649-c26694b22c94', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3823672-ea9e-441e-92b2-d0a2b0a90cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:13 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Volume volume-5c10f01b-38ff-4111-8649-c26694b22c94 (5c10f01b-38ff-4111-8649-c26694b22c94): created successfully
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3823672-ea9e-441e-92b2-d0a2b0a90cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Flow 'volume_create_manager' (f7dcb609-ae59-4dc5-a5e3-438b2c6c4bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c4881799-99d5-4255-aa63-ef68275c2085 tempest-ProjectReaderTests-1877153596 None] Created volume successfully.
Nov 07 02:53:13 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d.ab1b67cf-ece0-459d-8027-a99fda727f2e" returned: 0 in 0.298s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-ab1b67cf-ece0-459d-8027-a99fda727f2e" released by "_delete_snapshot" :: held 1.736s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-eee1762d-441c-4638-858f-69af033b8a4d" released by "delete_snapshot" :: held 1.770s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Created reservations ['0e9e962c-fdc4-431f-87cc-50dec7e35e2c', '59615787-9d18-4eb9-b610-a89b48c69583', '80019a4a-2cc6-42d8-9936-5cf25e4d98f6', '265c19d6-226b-4da1-a7cc-698b047acb6d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:13 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Delete snapshot completed successfully.
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-29386e26-beca-4fac-984c-4e851cef6a8e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-ab1b67cf-ece0-459d-8027-a99fda727f2e-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] Creating offline snapshot f902a6f6-2061-4960-a7c4-e00f187844c0 of volume 066852ef-da13-429d-926f-dcc41c32bedd {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a8b439-3322-4217-87d5-68d90896d4c7]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:13 devstack sudo[107804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd
Nov 07 02:53:13 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-eee1762d-441c-4638-858f-69af033b8a4d-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Lock "cinder-eee1762d-441c-4638-858f-69af033b8a4d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-eee1762d-441c-4638-858f-69af033b8a4d" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-eee1762d-441c-4638-858f-69af033b8a4d" acquired by "delete_volume" :: waited 0.024s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:13 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Acquiring lock "cinder-5c10f01b-38ff-4111-8649-c26694b22c94-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Lock "cinder-5c10f01b-38ff-4111-8649-c26694b22c94-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[51332829-aff7-4f87-abba-b7f47e08830e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Acquiring lock "cinder-quobyte-5c10f01b-38ff-4111-8649-c26694b22c94" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Lock "cinder-quobyte-5c10f01b-38ff-4111-8649-c26694b22c94" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8048198b-ff5f-4661-a582-04138b4bce10]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:14 devstack sudo[107806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d
Nov 07 02:53:14 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:14 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd" returned: 0 in 0.519s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:14 devstack sudo[107812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0 1G
Nov 07 02:53:14 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:14 devstack sudo[107809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94
Nov 07 02:53:14 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:14 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d" returned: 0 in 0.475s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:14 devstack sudo[107824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d
Nov 07 02:53:14 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:14 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94" returned: 0 in 0.463s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:14 devstack sudo[107828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94
Nov 07 02:53:14 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:14 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0 1G" returned: 0 in 0.593s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-066852ef-da13-429d-926f-dcc41c32bedd -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:14 devstack sudo[107834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-066852ef-da13-429d-926f-dcc41c32bedd -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0
Nov 07 02:53:14 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:14 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-eee1762d-441c-4638-858f-69af033b8a4d" returned: 0 in 0.364s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-eee1762d-441c-4638-858f-69af033b8a4d" released by "delete_volume" :: held 0.952s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:14 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5c10f01b-38ff-4111-8649-c26694b22c94" returned: 0 in 0.306s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Lock "cinder-quobyte-5c10f01b-38ff-4111-8649-c26694b22c94" released by "delete_volume" :: held 0.824s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:14 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Created reservations ['65224948-ab72-4a0e-a5be-b832b60d3a8a', '1891e189-9e24-4547-8248-d62276f9757b', '9e6b5b91-66f5-40fa-b74d-4a7d3cb1222b', 'db925faf-9c44-44c9-9767-ae97107f57e4'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Created reservations ['72fd82d5-abf8-47d1-809b-6b900d583f60', 'a2275885-db1f-4e95-8655-382c1eb486fe', '51695ba0-fb66-4212-9dcc-984fc5ddd608', '4d509a52-e9d0-47a9-af46-b66227e8741d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:15 devstack sudo[107841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:15 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:15 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-066852ef-da13-429d-926f-dcc41c32bedd -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0" returned: 0 in 0.418s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:15 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0 is being set with open permissions: ugo+rw
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:15 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:15 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:15 devstack sudo[107844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0
Nov 07 02:53:15 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:15 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.331s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Deleted volume successfully.
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6e648289-c603-4e02-bb50-a6d4ba773d1a tempest-ProjectMemberTests-1264181528 None] Lock "cinder-eee1762d-441c-4638-858f-69af033b8a4d-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:15 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.336s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:15 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Deleted volume successfully.
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-fa0ff3c9-d334-4a0c-ad0a-8b12768e6413 tempest-ProjectReaderTests-1877153596 None] Lock "cinder-5c10f01b-38ff-4111-8649-c26694b22c94-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:15 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0" returned: 0 in 0.382s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:15 devstack sudo[107850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.info
Nov 07 02:53:15 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:15 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.info" returned: 0 in 0.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:15 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.info is being set with open permissions: ugo+rw
Nov 07 02:53:15 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:15 devstack sudo[107853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.info
Nov 07 02:53:15 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:16 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.info" returned: 0 in 0.332s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.632s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:16 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-e9686e3c-6196-4166-94be-865960bd0483 tempest-ProjectReaderTests-344415422 None] Create snapshot completed successfully
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (e2edb545-2e0a-4be0-a0a7-a5b4f91783e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9ac84a-53b0-4e76-bc32-b175c34d804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9ac84a-53b0-4e76-bc32-b175c34d804e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1236754990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cde5cb5-25a6-444c-bc48-a9856a67b6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:17Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db0c1b3-f3ab-4cf6-9013-eb2ce627117b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db0c1b3-f3ab-4cf6-9013-eb2ce627117b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd803df5-4a22-4c0b-b21e-98bfec7430e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd803df5-4a22-4c0b-b21e-98bfec7430e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cde5cb5-25a6-444c-bc48-a9856a67b6d4', 'volume_name': 'volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2cfd3f-2eac-42e8-b33b-862371b4b895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2cfd3f-2eac-42e8-b33b-862371b4b895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698261dc-56cf-428b-a66c-52569e72363c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:16 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Volume 9cde5cb5-25a6-444c-bc48-a9856a67b6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4', 'volume_size': 1}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1236754990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cde5cb5-25a6-444c-bc48-a9856a67b6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:17Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Creating volume 9cde5cb5-25a6-444c-bc48-a9856a67b6d4 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:16 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:16 devstack sudo[107856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 1073741824
Nov 07 02:53:16 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-f902a6f6-2061-4960-a7c4-e00f187844c0-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Lock "cinder-f902a6f6-2061-4960-a7c4-e00f187844c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-066852ef-da13-429d-926f-dcc41c32bedd" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-066852ef-da13-429d-926f-dcc41c32bedd" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:16 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-f902a6f6-2061-4960-a7c4-e00f187844c0" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-f902a6f6-2061-4960-a7c4-e00f187844c0" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Deleting offline snapshot f902a6f6-2061-4960-a7c4-e00f187844c0 of volume 066852ef-da13-429d-926f-dcc41c32bedd {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] snapshot_file for this snap is: volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ed4d0f-c8d6-4846-8027-ec06ae3cb68a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:17 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0
Nov 07 02:53:17 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:17 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 1073741824" returned: 0 in 0.632s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:17 devstack sudo[107866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4
Nov 07 02:53:17 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:17 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0" returned: 0 in 0.476s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-066852ef-da13-429d-926f-dcc41c32bedd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcde2aaf-6d6b-41db-abca-5c7ad34cd6b1]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:17 devstack sudo[107869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd
Nov 07 02:53:17 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:17 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4" returned: 0 in 0.273s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698261dc-56cf-428b-a66c-52569e72363c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec61f7b-9392-49a6-aa1b-4a3f3ac26640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:17 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Volume volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 (9cde5cb5-25a6-444c-bc48-a9856a67b6d4): created successfully
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec61f7b-9392-49a6-aa1b-4a3f3ac26640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (e2edb545-2e0a-4be0-a0a7-a5b4f91783e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:17 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-eea317f2-f808-4849-ad0e-7bf55dac4a14 tempest-ProjectMemberTests-1264181528 None] Created volume successfully.
Nov 07 02:53:17 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd" returned: 0 in 0.372s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:17 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:17 devstack sudo[107875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0
Nov 07 02:53:17 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:18 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0" returned: 0 in 0.326s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:18 devstack sudo[107881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0
Nov 07 02:53:18 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:18 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd.f902a6f6-2061-4960-a7c4-e00f187844c0" returned: 0 in 0.244s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-f902a6f6-2061-4960-a7c4-e00f187844c0" released by "_delete_snapshot" :: held 1.553s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-066852ef-da13-429d-926f-dcc41c32bedd" released by "delete_snapshot" :: held 1.589s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Created reservations ['dfd01866-6105-44a3-8181-d416f0ca5958', '05e20b40-fe61-48d0-ae5b-970b821ba279', 'ed35c4b6-af4b-4308-80a6-798d06459dbc', '254d92ef-696d-430d-a493-98a411d99d89'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:18 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Delete snapshot completed successfully.
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4463fe6a-22c1-41a7-a2d7-b006f725facd tempest-ProjectReaderTests-344415422 None] Lock "cinder-f902a6f6-2061-4960-a7c4-e00f187844c0-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] Creating offline snapshot 476bfd4c-3a93-4a23-9188-449974a6a5aa of volume 9cde5cb5-25a6-444c-bc48-a9856a67b6d4 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[7291a44c-2451-46b6-a398-9dd1e4e80af3]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:18 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:19 devstack sudo[107884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4
Nov 07 02:53:19 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-066852ef-da13-429d-926f-dcc41c32bedd-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Lock "cinder-066852ef-da13-429d-926f-dcc41c32bedd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-066852ef-da13-429d-926f-dcc41c32bedd" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-066852ef-da13-429d-926f-dcc41c32bedd" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d6e7d2-1ef7-4a06-ad47-95f543b0895d]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:19 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4" returned: 0 in 0.384s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:19 devstack sudo[107886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd
Nov 07 02:53:19 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:19 devstack sudo[107891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa 1G
Nov 07 02:53:19 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:19 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd" returned: 0 in 0.394s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:19 devstack sudo[107899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd
Nov 07 02:53:19 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:19 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa 1G" returned: 0 in 0.437s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:19 devstack sudo[107902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa
Nov 07 02:53:19 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:19 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-066852ef-da13-429d-926f-dcc41c32bedd" returned: 0 in 0.265s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-066852ef-da13-429d-926f-dcc41c32bedd" released by "delete_volume" :: held 0.728s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Created reservations ['933e82d2-ecf2-4f14-9cac-03eafdd197ae', 'cbfadf15-6ef5-43a4-a032-b9dd9c6f0659', '769b1770-7ab2-4c6d-9c56-9bda71cbe0a7', 'fb8adf18-625b-4939-8832-4fa025a19637'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:19 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:20 devstack sudo[107907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:20 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:20 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa" returned: 0 in 0.320s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:20 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa is being set with open permissions: ugo+rw
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:20 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa
Nov 07 02:53:20 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:20 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.256s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Deleted volume successfully.
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68ab90a8-497e-48f3-8bfe-81c029284511 tempest-ProjectReaderTests-344415422 None] Lock "cinder-066852ef-da13-429d-926f-dcc41c32bedd-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:20 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa" returned: 0 in 0.266s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:20 devstack sudo[107914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.info
Nov 07 02:53:20 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:20 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.info" returned: 0 in 0.274s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:20 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.info is being set with open permissions: ugo+rw
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:20 devstack sudo[107917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.info
Nov 07 02:53:20 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Flow 'volume_create_manager' (54abfed7-23b8-46f4-a98d-0e2f29c244d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa0cedb-a504-47ae-a796-46c1b405e6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa0cedb-a504-47ae-a796-46c1b405e6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783874219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcac3fe-b27f-4f7d-bc22-805cd758a970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f8124e1a01410db31a360d3a075b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:21Z,use_quota=True,user_id='e45f050e2f544e2595ba850c10530d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3c1b21-6ca1-403c-a6b2-068c1f68da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3c1b21-6ca1-403c-a6b2-068c1f68da50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb56bc22-7e68-4680-97b9-83942a95379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb56bc22-7e68-4680-97b9-83942a95379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbcac3fe-b27f-4f7d-bc22-805cd758a970', 'volume_name': 'volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6538cb-5e36-463d-9e83-3ac935a7ccaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6538cb-5e36-463d-9e83-3ac935a7ccaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460a29ee-d28f-4fe1-a78c-cd3dcc956346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:20 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Volume cbcac3fe-b27f-4f7d-bc22-805cd758a970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970', 'volume_size': 1}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:20 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.info" returned: 0 in 0.254s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.120s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783874219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcac3fe-b27f-4f7d-bc22-805cd758a970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f8124e1a01410db31a360d3a075b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:21Z,use_quota=True,user_id='e45f050e2f544e2595ba850c10530d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Creating volume cbcac3fe-b27f-4f7d-bc22-805cd758a970 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:20 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:20 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:20 devstack sudo[107920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 1073741824
Nov 07 02:53:20 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:20 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1feb2b1b-4051-48ca-b4c5-2faa7e3fc49a tempest-ProjectMemberTests-1264181528 None] Create snapshot completed successfully
Nov 07 02:53:21 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 1073741824" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:21 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970
Nov 07 02:53:21 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:21 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:21 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:21 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460a29ee-d28f-4fe1-a78c-cd3dcc956346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114ae918-cd13-4215-802b-b1c75dbafc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:21 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Volume volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 (cbcac3fe-b27f-4f7d-bc22-805cd758a970): created successfully
Nov 07 02:53:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114ae918-cd13-4215-802b-b1c75dbafc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:21 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Flow 'volume_create_manager' (54abfed7-23b8-46f4-a98d-0e2f29c244d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:21 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-1f709127-3df7-4ba5-a1b9-6f5bd203bc66 tempest-ProjectReaderTests-344415422 None] Created volume successfully.
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-476bfd4c-3a93-4a23-9188-449974a6a5aa-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-476bfd4c-3a93-4a23-9188-449974a6a5aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-9cde5cb5-25a6-444c-bc48-a9856a67b6d4" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-9cde5cb5-25a6-444c-bc48-a9856a67b6d4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-476bfd4c-3a93-4a23-9188-449974a6a5aa" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-476bfd4c-3a93-4a23-9188-449974a6a5aa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Deleting offline snapshot 476bfd4c-3a93-4a23-9188-449974a6a5aa of volume 9cde5cb5-25a6-444c-bc48-a9856a67b6d4 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] snapshot_file for this snap is: volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa58eb3-7cf2-4b46-b121-9528039a6a76]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:22 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa
Nov 07 02:53:22 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:22 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf246fcb-7f5e-4549-a4fe-4ff699771c2e]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:22 devstack sudo[107933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4
Nov 07 02:53:22 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:22 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4" returned: 0 in 0.360s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:22 devstack sudo[107938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa
Nov 07 02:53:22 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:22 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] Creating offline snapshot b840526d-105a-4685-a431-266760953f85 of volume cbcac3fe-b27f-4f7d-bc22-805cd758a970 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da20702-6c05-4a10-86c7-4566a7971bf0]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:23 devstack sudo[107940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970
Nov 07 02:53:23 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:23 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa" returned: 0 in 0.362s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:23 devstack sudo[107946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa
Nov 07 02:53:23 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:23 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:23 devstack sudo[107952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85 1G
Nov 07 02:53:23 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:23 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4.476bfd4c-3a93-4a23-9188-449974a6a5aa" returned: 0 in 0.252s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-476bfd4c-3a93-4a23-9188-449974a6a5aa" released by "_delete_snapshot" :: held 1.433s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-9cde5cb5-25a6-444c-bc48-a9856a67b6d4" released by "delete_snapshot" :: held 1.456s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Created reservations ['1bf14721-695c-403a-a828-459b0785e300', '6484935d-ae7e-4c86-b005-80d571a4d0de', '05596417-de92-41dc-8649-4e60b713438b', 'aec0bd74-6dfe-4026-93fb-0e48ebed0676'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:23 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Delete snapshot completed successfully.
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-71dfde81-d161-4db2-b9dd-c9d39ab42321 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-476bfd4c-3a93-4a23-9188-449974a6a5aa-delete_snapshot" released by "delete_snapshot" :: held 1.595s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:23 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85 1G" returned: 0 in 0.417s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:23 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:23 devstack sudo[107959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85
Nov 07 02:53:23 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:24 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85" returned: 0 in 0.283s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:24 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85 is being set with open permissions: ugo+rw
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:24 devstack sudo[107964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85
Nov 07 02:53:24 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-9cde5cb5-25a6-444c-bc48-a9856a67b6d4-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Lock "cinder-9cde5cb5-25a6-444c-bc48-a9856a67b6d4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-9cde5cb5-25a6-444c-bc48-a9856a67b6d4" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-9cde5cb5-25a6-444c-bc48-a9856a67b6d4" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[882cc526-40e6-43b8-afa0-cde41adf3158]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:24 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85" returned: 0 in 0.247s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:24 devstack sudo[107968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.info
Nov 07 02:53:24 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:24 devstack sudo[107967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4
Nov 07 02:53:24 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:24 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.info" returned: 0 in 0.245s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:24 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.info is being set with open permissions: ugo+rw
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:24 devstack sudo[107974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.info
Nov 07 02:53:24 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:24 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4" returned: 0 in 0.369s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:24 devstack sudo[107977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4
Nov 07 02:53:24 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:24 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.info" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:24 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-bc5ddbd0-08f8-4aef-8ff5-b9f9af44837f tempest-ProjectReaderTests-344415422 None] Create snapshot completed successfully
Nov 07 02:53:24 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-9cde5cb5-25a6-444c-bc48-a9856a67b6d4" returned: 0 in 0.256s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:24 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-9cde5cb5-25a6-444c-bc48-a9856a67b6d4" released by "delete_volume" :: held 0.690s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Created reservations ['107df590-217b-4746-a239-427f10ba6ff1', '48d328f9-d157-43a1-954a-3f02251b50b7', 'a022fa36-e583-4ae3-b202-2e677f478a6b', '5b992720-e2c2-4a09-80ca-2f96e95a43c2'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-b840526d-105a-4685-a431-266760953f85-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Lock "cinder-b840526d-105a-4685-a431-266760953f85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-cbcac3fe-b27f-4f7d-bc22-805cd758a970" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-cbcac3fe-b27f-4f7d-bc22-805cd758a970" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-b840526d-105a-4685-a431-266760953f85" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:25 devstack sudo[107981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:25 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-b840526d-105a-4685-a431-266760953f85" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Deleting offline snapshot b840526d-105a-4685-a431-266760953f85 of volume cbcac3fe-b27f-4f7d-bc22-805cd758a970 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] snapshot_file for this snap is: volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d5c8ab-2b73-46c8-9b82-db4c9d3926f3]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:25 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85
Nov 07 02:53:25 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:25 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.263s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Deleted volume successfully.
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-727c5152-4811-4391-a9b5-fc73fb3cceab tempest-ProjectMemberTests-1264181528 None] Lock "cinder-9cde5cb5-25a6-444c-bc48-a9856a67b6d4-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:25 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85" returned: 0 in 0.377s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6bfe28-aa5c-457e-a9b8-d5d0fe0d6aa2]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:25 devstack sudo[107989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970
Nov 07 02:53:25 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (6b8a076c-4817-4080-9093-bda451b98bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f8682c-1604-4edd-84f3-6521679d1a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f8682c-1604-4edd-84f3-6521679d1a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1011970794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69057b2-178b-4c30-8a0c-4a91424db621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:26Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4144d9-ca28-4809-9c17-251e161a219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4144d9-ca28-4809-9c17-251e161a219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c3bc30-6f7e-4d25-9a85-70cede739601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c3bc30-6f7e-4d25-9a85-70cede739601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a69057b2-178b-4c30-8a0c-4a91424db621', 'volume_name': 'volume-a69057b2-178b-4c30-8a0c-4a91424db621', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ded1d3-cf01-42d4-9641-08bf4eef5bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ded1d3-cf01-42d4-9641-08bf4eef5bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad67376-000f-4118-9251-368c877a2995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Volume a69057b2-178b-4c30-8a0c-4a91424db621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a69057b2-178b-4c30-8a0c-4a91424db621', 'volume_size': 1}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1011970794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69057b2-178b-4c30-8a0c-4a91424db621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:26Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Creating volume a69057b2-178b-4c30-8a0c-4a91424db621 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:25 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:25 devstack sudo[107994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621 1073741824
Nov 07 02:53:25 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:26 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970" returned: 0 in 0.392s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:26 devstack sudo[107997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85
Nov 07 02:53:26 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:26 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85" returned: 0 in 0.365s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:26 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621 1073741824" returned: 0 in 0.454s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:26 devstack sudo[108005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85
Nov 07 02:53:26 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:26 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621
Nov 07 02:53:26 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:26 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970.b840526d-105a-4685-a431-266760953f85" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-b840526d-105a-4685-a431-266760953f85" released by "_delete_snapshot" :: held 1.499s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:26 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621" returned: 0 in 0.252s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-cbcac3fe-b27f-4f7d-bc22-805cd758a970" released by "delete_snapshot" :: held 1.538s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad67376-000f-4118-9251-368c877a2995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69057b2-178b-4c30-8a0c-4a91424db621', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51eb1964-d1d1-4b00-bd7a-454371ac2a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:26 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Volume volume-a69057b2-178b-4c30-8a0c-4a91424db621 (a69057b2-178b-4c30-8a0c-4a91424db621): created successfully
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51eb1964-d1d1-4b00-bd7a-454371ac2a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (6b8a076c-4817-4080-9093-bda451b98bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-61a3eb4a-4867-4d44-8ca6-06fd4e79eadc tempest-ProjectMemberTests-1264181528 None] Created volume successfully.
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Created reservations ['4b332a5a-7108-4b9c-af67-f68b50377bf5', '34c3468b-1f8d-4184-bb76-6461ecf4884f', 'b96871f7-6d58-4247-b185-696f202dece8', '0965e1e8-abaa-4bcf-9db3-dcadbd78d07d'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:26 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Delete snapshot completed successfully.
Nov 07 02:53:26 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-6dd24981-01e8-4f2b-80f7-604126b3fcd8 tempest-ProjectReaderTests-344415422 None] Lock "cinder-b840526d-105a-4685-a431-266760953f85-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] Creating offline snapshot 290cf915-04ce-481e-80bf-820ec3f7f496 of volume a69057b2-178b-4c30-8a0c-4a91424db621 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[25953a48-a31c-4230-9901-9538d08f9964]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:27 devstack sudo[108011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621
Nov 07 02:53:27 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-cbcac3fe-b27f-4f7d-bc22-805cd758a970-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Lock "cinder-cbcac3fe-b27f-4f7d-bc22-805cd758a970-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Acquiring lock "cinder-quobyte-cbcac3fe-b27f-4f7d-bc22-805cd758a970" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-cbcac3fe-b27f-4f7d-bc22-805cd758a970" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53e9ef7-a3c2-49b8-a332-fd7f1ab6bbe1]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:27 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621" returned: 0 in 0.375s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:27 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496 1G
Nov 07 02:53:27 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:27 devstack sudo[108017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970
Nov 07 02:53:27 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:27 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970" returned: 0 in 0.382s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:27 devstack sudo[108027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970
Nov 07 02:53:27 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:27 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496 1G" returned: 0 in 0.423s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69057b2-178b-4c30-8a0c-4a91424db621 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:27 devstack sudo[108030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69057b2-178b-4c30-8a0c-4a91424db621 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496
Nov 07 02:53:27 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:28 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-cbcac3fe-b27f-4f7d-bc22-805cd758a970" returned: 0 in 0.265s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Lock "cinder-quobyte-cbcac3fe-b27f-4f7d-bc22-805cd758a970" released by "delete_volume" :: held 0.715s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Created reservations ['9015c756-0387-4e74-9458-2b3c7a319072', 'e720aeae-a77d-4752-bff0-c6a00680fbdf', 'b3a216bc-5f52-4b00-8bb3-46bbe8652641', '68439568-ab9e-4a96-a5bd-62bec413d9b3'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:28 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69057b2-178b-4c30-8a0c-4a91424db621 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496" returned: 0 in 0.316s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:28 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496 is being set with open permissions: ugo+rw
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:28 devstack sudo[108036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:28 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:28 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:28 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:28 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496" returned: 0 in 0.268s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:28 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.252s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Deleted volume successfully.
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-68b9a81f-b0a9-48d3-9694-5944d1854516 tempest-ProjectReaderTests-344415422 None] Lock "cinder-cbcac3fe-b27f-4f7d-bc22-805cd758a970-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:28 devstack sudo[108045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.info
Nov 07 02:53:28 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:28 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.info" returned: 0 in 0.269s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:28 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.info is being set with open permissions: ugo+rw
Nov 07 02:53:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:28 devstack sudo[108048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.info
Nov 07 02:53:28 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:29 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.info" returned: 0 in 0.278s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:29 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-04872c2e-2bab-478b-8d25-b59847765e4d tempest-ProjectMemberTests-1264181528 None] Create snapshot completed successfully
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-290cf915-04ce-481e-80bf-820ec3f7f496-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-290cf915-04ce-481e-80bf-820ec3f7f496-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-a69057b2-178b-4c30-8a0c-4a91424db621" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-a69057b2-178b-4c30-8a0c-4a91424db621" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-290cf915-04ce-481e-80bf-820ec3f7f496" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-290cf915-04ce-481e-80bf-820ec3f7f496" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Deleting offline snapshot 290cf915-04ce-481e-80bf-820ec3f7f496 of volume a69057b2-178b-4c30-8a0c-4a91424db621 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] snapshot_file for this snap is: volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[881ad484-fe48-47f1-94b4-44f03c279fdd]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:30 devstack sudo[108051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496
Nov 07 02:53:30 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:30 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496" returned: 0 in 0.366s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a69057b2-178b-4c30-8a0c-4a91424db621(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9444d247-d281-4d11-9ff4-c696af0150df]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:30 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:30 devstack sudo[108056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621
Nov 07 02:53:30 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:31 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621" returned: 0 in 0.369s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:31 devstack sudo[108061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496
Nov 07 02:53:31 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:31 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:31 devstack sudo[108066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496
Nov 07 02:53:31 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:31 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:31 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621.290cf915-04ce-481e-80bf-820ec3f7f496" returned: 0 in 0.257s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-290cf915-04ce-481e-80bf-820ec3f7f496" released by "_delete_snapshot" :: held 1.463s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-a69057b2-178b-4c30-8a0c-4a91424db621" released by "delete_snapshot" :: held 1.487s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:31 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Created reservations ['7b59212c-ffd6-498b-a1bb-a23331bbbcfe', '514de634-0de3-4aa2-b1e7-a3676a2d12c3', '6afaf549-27c7-4814-ab97-74ba760b0e1f', '117790ba-62cb-46a1-b694-b5706b38f4f1'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:31 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Delete snapshot completed successfully.
Nov 07 02:53:31 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc1d2df3-2678-43b0-8678-d24d81dd5d66 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-290cf915-04ce-481e-80bf-820ec3f7f496-delete_snapshot" released by "delete_snapshot" :: held 1.628s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-a69057b2-178b-4c30-8a0c-4a91424db621-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-a69057b2-178b-4c30-8a0c-4a91424db621-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-a69057b2-178b-4c30-8a0c-4a91424db621" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:32 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-a69057b2-178b-4c30-8a0c-4a91424db621" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:32 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a0acae-34a2-4570-8c04-945aefc7d02c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:32 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621
Nov 07 02:53:32 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:32 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621" returned: 0 in 0.366s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:32 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:32 devstack sudo[108074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621
Nov 07 02:53:32 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:33 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-a69057b2-178b-4c30-8a0c-4a91424db621" returned: 0 in 0.240s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-a69057b2-178b-4c30-8a0c-4a91424db621" released by "delete_volume" :: held 0.671s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Created reservations ['a84dcea7-ceb8-470a-9295-5590af4e7543', 'e846f90d-bfda-4920-b896-c2b7d5679918', 'd4f39484-1bc9-43c0-beba-d0c779a8c79b', '64b4e241-c7b5-475d-a14d-74dd28875905'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:33 devstack sudo[108077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:33 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:33 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.256s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:33 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Deleted volume successfully.
Nov 07 02:53:33 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-3125b5b7-4348-4f5e-b253-59a13d2b8c02 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-a69057b2-178b-4c30-8a0c-4a91424db621-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (2810d67d-af57-48f6-b2cf-3b0ff49cf971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a9de16-6be7-4cb8-9076-08dbcc9b9643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a9de16-6be7-4cb8-9076-08dbcc9b9643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567394633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6b99fe-63d2-4d0e-9ab1-46ba3950912e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:34Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0756d470-7e48-403b-a6a7-ac9e91716a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0756d470-7e48-403b-a6a7-ac9e91716a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648f135a-a768-480c-9010-7d7760689c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648f135a-a768-480c-9010-7d7760689c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c6b99fe-63d2-4d0e-9ab1-46ba3950912e', 'volume_name': 'volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6d29f7-da3a-4377-bf56-ce1cd11ba5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6d29f7-da3a-4377-bf56-ce1cd11ba5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a756ef-497e-4de6-9008-4c9cd94e5429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Volume 4c6b99fe-63d2-4d0e-9ab1-46ba3950912e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e', 'volume_size': 1}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567394633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6b99fe-63d2-4d0e-9ab1-46ba3950912e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:34Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Creating volume 4c6b99fe-63d2-4d0e-9ab1-46ba3950912e {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:34 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:34 devstack sudo[108080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e 1073741824
Nov 07 02:53:34 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:34 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e 1073741824" returned: 0 in 0.427s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:34 devstack sudo[108086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e
Nov 07 02:53:34 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:34 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e" returned: 0 in 0.242s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a756ef-497e-4de6-9008-4c9cd94e5429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42273b60-6e72-4407-9172-a60ebcde24f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:34 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Volume volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e (4c6b99fe-63d2-4d0e-9ab1-46ba3950912e): created successfully
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42273b60-6e72-4407-9172-a60ebcde24f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:34 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (2810d67d-af57-48f6-b2cf-3b0ff49cf971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:34 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-778371a3-222b-49b3-b84c-91083569f946 tempest-ProjectMemberTests-1264181528 None] Created volume successfully.
Nov 07 02:53:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:35 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] Creating offline snapshot 60030503-38b6-4042-b28e-97407a302dae of volume 4c6b99fe-63d2-4d0e-9ab1-46ba3950912e {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:35 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb3725d-4475-429e-a5cc-12daf62aea54]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:35 devstack sudo[108089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e
Nov 07 02:53:35 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:35 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:35 devstack sudo[108094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae 1G
Nov 07 02:53:35 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:36 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae 1G" returned: 0 in 0.450s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:36 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae
Nov 07 02:53:36 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:36 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae" returned: 0 in 0.301s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:36 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae is being set with open permissions: ugo+rw
Nov 07 02:53:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:36 devstack sudo[108105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae
Nov 07 02:53:36 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:36 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:36 devstack sudo[108108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.info
Nov 07 02:53:36 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:36 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.info" returned: 0 in 0.244s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:36 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.info is being set with open permissions: ugo+rw
Nov 07 02:53:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:36 devstack sudo[108111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.info
Nov 07 02:53:36 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:37 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.info" returned: 0 in 0.251s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:37 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-405ed021-1bda-40d7-bbcc-149baf57478e tempest-ProjectMemberTests-1264181528 None] Create snapshot completed successfully
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-60030503-38b6-4042-b28e-97407a302dae-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Lock "cinder-60030503-38b6-4042-b28e-97407a302dae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-60030503-38b6-4042-b28e-97407a302dae" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-60030503-38b6-4042-b28e-97407a302dae" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Deleting offline snapshot 60030503-38b6-4042-b28e-97407a302dae of volume 4c6b99fe-63d2-4d0e-9ab1-46ba3950912e {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] snapshot_file for this snap is: volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e22aab-f054-4460-9dba-38b2c06821dd]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:37 devstack sudo[108114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae
Nov 07 02:53:37 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:37 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae" returned: 0 in 0.390s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad02175c-f6d7-418a-98a4-24afb2e865b0]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:37 devstack sudo[108119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e
Nov 07 02:53:37 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:38 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e" returned: 0 in 0.367s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:38 devstack sudo[108125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae
Nov 07 02:53:38 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:38 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae" returned: 0 in 0.369s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:38 devstack sudo[108131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae
Nov 07 02:53:38 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:38 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e.60030503-38b6-4042-b28e-97407a302dae" returned: 0 in 0.281s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-60030503-38b6-4042-b28e-97407a302dae" released by "_delete_snapshot" :: held 1.518s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e" released by "delete_snapshot" :: held 1.543s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Created reservations ['3390efde-ae5c-4e00-8e4d-5fb336efec88', 'c2db4cf9-7e27-40ec-bde2-982c93c71e64', 'ca6411b3-9e07-4257-8be7-5fd29b2a08b5', 'a2d8535a-5f4b-47fd-b662-1dbb1d5ebb7a'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Delete snapshot completed successfully.
Nov 07 02:53:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-51970ddf-bfa6-4476-a585-8ba463af217b tempest-ProjectMemberTests-1264181528 None] Lock "cinder-60030503-38b6-4042-b28e-97407a302dae-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:39 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[93344110-bf48-41b9-a475-6a0871bf0aaa]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:39 devstack sudo[108134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e
Nov 07 02:53:39 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:39 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e" returned: 0 in 0.374s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:39 devstack sudo[108139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e
Nov 07 02:53:39 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:40 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e" returned: 0 in 0.259s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e" released by "delete_volume" :: held 0.699s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Created reservations ['0c5e2a67-60f6-4bdf-a761-417ce360c378', '80b2bb8f-3ce7-4e7d-bdb7-78cde799f4b3', '36af3545-770c-48fb-b441-65d42c73563f', '44169415-6ee1-4e70-bea8-9f03a88b9354'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:40 devstack sudo[108142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:40 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:40 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.270s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:40 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Deleted volume successfully.
Nov 07 02:53:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-21f898cb-990d-4c51-939e-2581b38007a0 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-4c6b99fe-63d2-4d0e-9ab1-46ba3950912e-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (6f936d83-3e84-416b-9e84-0a517fb845c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6d7c8b-e593-4c3e-97d4-5f6eaa6b0d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6d7c8b-e593-4c3e-97d4-5f6eaa6b0d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1722931663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216a5bec-50db-4977-86e7-7164ba9c63be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:41Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3273b6-649d-4fd4-b35e-314ee970e690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3273b6-649d-4fd4-b35e-314ee970e690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbf8e11-3292-4305-ae35-150159d7140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbf8e11-3292-4305-ae35-150159d7140d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '216a5bec-50db-4977-86e7-7164ba9c63be', 'volume_name': 'volume-216a5bec-50db-4977-86e7-7164ba9c63be', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfc6078-09df-4701-9261-fee283d54d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfc6078-09df-4701-9261-fee283d54d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444d31c8-c379-4d7c-ad0a-17092d6baec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:41 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Volume 216a5bec-50db-4977-86e7-7164ba9c63be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-216a5bec-50db-4977-86e7-7164ba9c63be', 'volume_size': 1}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1722931663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216a5bec-50db-4977-86e7-7164ba9c63be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:41Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Creating volume 216a5bec-50db-4977-86e7-7164ba9c63be {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:41 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:41 devstack sudo[108145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be 1073741824
Nov 07 02:53:41 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:41 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be 1073741824" returned: 0 in 0.435s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:41 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:41 devstack sudo[108187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be
Nov 07 02:53:41 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:42 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be" returned: 0 in 0.261s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:42 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:42 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444d31c8-c379-4d7c-ad0a-17092d6baec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-216a5bec-50db-4977-86e7-7164ba9c63be', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c138ebe7-ea1c-460b-a746-2b05f5b04a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:42 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Volume volume-216a5bec-50db-4977-86e7-7164ba9c63be (216a5bec-50db-4977-86e7-7164ba9c63be): created successfully
Nov 07 02:53:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c138ebe7-ea1c-460b-a746-2b05f5b04a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:42 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (6f936d83-3e84-416b-9e84-0a517fb845c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:42 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-c649d5d7-eb3c-48c0-b094-9246e1c7cfb1 tempest-ProjectMemberTests-1264181528 None] Created volume successfully.
Nov 07 02:53:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:43 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] Creating offline snapshot 0e722abe-fd1d-4e3b-9d94-27b4e12c3042 of volume 216a5bec-50db-4977-86e7-7164ba9c63be {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:43 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71302b1-7b5e-4882-86ec-3f6cea0afc8f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:43 devstack sudo[108190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be
Nov 07 02:53:43 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:43 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be" returned: 0 in 0.351s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:43 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:43 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042 1G
Nov 07 02:53:43 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:44 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042 1G" returned: 0 in 0.437s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-216a5bec-50db-4977-86e7-7164ba9c63be -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:44 devstack sudo[108203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-216a5bec-50db-4977-86e7-7164ba9c63be -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042
Nov 07 02:53:44 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:44 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-216a5bec-50db-4977-86e7-7164ba9c63be -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042" returned: 0 in 0.312s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:44 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042 is being set with open permissions: ugo+rw
Nov 07 02:53:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:44 devstack sudo[108208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042
Nov 07 02:53:44 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:44 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042" returned: 0 in 0.252s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:44 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:44 devstack sudo[108211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.info
Nov 07 02:53:44 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:45 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.info" returned: 0 in 0.272s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:45 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.info is being set with open permissions: ugo+rw
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:45 devstack sudo[108214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.info
Nov 07 02:53:45 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:45 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.info" returned: 0 in 0.271s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:45 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d522e464-0d0a-4fe5-a766-0c392df8cf02 tempest-ProjectMemberTests-1264181528 None] Create snapshot completed successfully
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-0e722abe-fd1d-4e3b-9d94-27b4e12c3042-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-0e722abe-fd1d-4e3b-9d94-27b4e12c3042-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-216a5bec-50db-4977-86e7-7164ba9c63be" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-216a5bec-50db-4977-86e7-7164ba9c63be" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-0e722abe-fd1d-4e3b-9d94-27b4e12c3042" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-0e722abe-fd1d-4e3b-9d94-27b4e12c3042" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Deleting offline snapshot 0e722abe-fd1d-4e3b-9d94-27b4e12c3042 of volume 216a5bec-50db-4977-86e7-7164ba9c63be {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] snapshot_file for this snap is: volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4632d764-ea71-4f1c-9662-c223d9712f6c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:45 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042
Nov 07 02:53:45 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:45 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042" returned: 0 in 0.380s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:45 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-216a5bec-50db-4977-86e7-7164ba9c63be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:46 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[884586ee-bda5-4be4-8c2c-a6a08c7df20c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:46 devstack sudo[108223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be
Nov 07 02:53:46 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:46 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be" returned: 0 in 0.383s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:46 devstack sudo[108228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042
Nov 07 02:53:46 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:46 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042" returned: 0 in 0.344s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:46 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042
Nov 07 02:53:46 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:46 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:46 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be.0e722abe-fd1d-4e3b-9d94-27b4e12c3042" returned: 0 in 0.253s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-0e722abe-fd1d-4e3b-9d94-27b4e12c3042" released by "_delete_snapshot" :: held 1.471s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-216a5bec-50db-4977-86e7-7164ba9c63be" released by "delete_snapshot" :: held 1.495s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:47 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Created reservations ['82affe68-edb4-449e-bcd1-a5fb37fb2a88', '003173a8-7f90-4516-b288-eeb019fa13f7', 'ba358b8b-de2b-4ece-a0ca-c5d6b8bc4ea5', '581e2503-29e8-4286-9ec8-a60a911e0c8f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:47 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Delete snapshot completed successfully.
Nov 07 02:53:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-ff6ca288-3b6b-41e0-b30e-fe3af65de202 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-0e722abe-fd1d-4e3b-9d94-27b4e12c3042-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-216a5bec-50db-4977-86e7-7164ba9c63be-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-216a5bec-50db-4977-86e7-7164ba9c63be-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-216a5bec-50db-4977-86e7-7164ba9c63be" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:47 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-216a5bec-50db-4977-86e7-7164ba9c63be" acquired by "delete_volume" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:47 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[19612497-0708-4830-bce7-a01b75acf30f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:47 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:47 devstack sudo[108244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be
Nov 07 02:53:47 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:48 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be" returned: 0 in 0.376s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:48 devstack sudo[108249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be
Nov 07 02:53:48 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:48 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-216a5bec-50db-4977-86e7-7164ba9c63be" returned: 0 in 0.256s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-216a5bec-50db-4977-86e7-7164ba9c63be" released by "delete_volume" :: held 0.704s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Created reservations ['3df8bc58-b66f-4e29-9921-19810df9e009', 'bba23ad2-196d-48f1-8951-9bf6bdb973b9', 'c34ca37a-28d8-4ee0-ac25-0ff684d2e79b', '5e2a4f58-d5c2-44b2-8292-98c3b42c2208'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:48 devstack sudo[108254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:48 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:48 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.315s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:48 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Deleted volume successfully.
Nov 07 02:53:48 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-afa15134-5712-427e-bf25-4e7c69f0ac71 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-216a5bec-50db-4977-86e7-7164ba9c63be-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (547c01cd-689e-4215-89c0-fe44fa07a435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a89df0d-9145-418d-99bf-53b8562437f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a89df0d-9145-418d-99bf-53b8562437f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142028955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f024b8-8eed-4450-988a-d22bbcd201a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:49Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f56e3d2-7b39-4441-8cd8-f1ae9aeed9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f56e3d2-7b39-4441-8cd8-f1ae9aeed9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97b514f-ab96-4ea4-b90c-c2f13fc12d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97b514f-ab96-4ea4-b90c-c2f13fc12d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f024b8-8eed-4450-988a-d22bbcd201a5', 'volume_name': 'volume-05f024b8-8eed-4450-988a-d22bbcd201a5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76efe6e1-6c0a-44e6-b42d-3444279c7622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76efe6e1-6c0a-44e6-b42d-3444279c7622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0299c5-7941-462b-9f6d-99fbd4339f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:49 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Volume 05f024b8-8eed-4450-988a-d22bbcd201a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f024b8-8eed-4450-988a-d22bbcd201a5', 'volume_size': 1}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142028955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f024b8-8eed-4450-988a-d22bbcd201a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c15d0954bfa43d08bfb284082074f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:49Z,use_quota=True,user_id='37ca96fe019a4633ba9ab56420e2e233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Creating volume 05f024b8-8eed-4450-988a-d22bbcd201a5 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:49 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:49 devstack sudo[108257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5 1073741824
Nov 07 02:53:49 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:49 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5 1073741824" returned: 0 in 0.443s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:49 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:49 devstack sudo[108263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5
Nov 07 02:53:49 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:50 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5" returned: 0 in 0.269s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0299c5-7941-462b-9f6d-99fbd4339f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f024b8-8eed-4450-988a-d22bbcd201a5', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183d05ec-d9cf-4302-8f8a-f405201511d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:50 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Volume volume-05f024b8-8eed-4450-988a-d22bbcd201a5 (05f024b8-8eed-4450-988a-d22bbcd201a5): created successfully
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183d05ec-d9cf-4302-8f8a-f405201511d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Flow 'volume_create_manager' (547c01cd-689e-4215-89c0-fe44fa07a435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:50 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-245cdc30-7255-4066-ae52-b0fd7927814e tempest-ProjectMemberTests-1264181528 None] Created volume successfully.
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] Creating offline snapshot 6977303c-5b59-4a24-9392-c0a9f5a7c9cc of volume 05f024b8-8eed-4450-988a-d22bbcd201a5 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[5155f2f7-546f-4d74-801a-b92757df13e8]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:50 devstack sudo[108266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5
Nov 07 02:53:50 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:50 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5" returned: 0 in 0.378s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:50 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:51 devstack sudo[108271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc 1G
Nov 07 02:53:51 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:51 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc 1G" returned: 0 in 0.386s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f024b8-8eed-4450-988a-d22bbcd201a5 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:51 devstack sudo[108277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f024b8-8eed-4450-988a-d22bbcd201a5 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc
Nov 07 02:53:51 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:51 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f024b8-8eed-4450-988a-d22bbcd201a5 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc" returned: 0 in 0.276s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:51 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc is being set with open permissions: ugo+rw
Nov 07 02:53:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:51 devstack sudo[108282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc
Nov 07 02:53:51 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:51 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc" returned: 0 in 0.242s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:51 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:51 devstack sudo[108285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.info
Nov 07 02:53:51 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:52 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.info" returned: 0 in 0.246s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:52 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.info is being set with open permissions: ugo+rw
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:52 devstack sudo[108288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.info
Nov 07 02:53:52 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:52 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.info" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:52 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-d7df13f9-2b75-48c0-8d04-8d50653e4753 tempest-ProjectMemberTests-1264181528 None] Create snapshot completed successfully
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-6977303c-5b59-4a24-9392-c0a9f5a7c9cc-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-6977303c-5b59-4a24-9392-c0a9f5a7c9cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-05f024b8-8eed-4450-988a-d22bbcd201a5" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-05f024b8-8eed-4450-988a-d22bbcd201a5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-6977303c-5b59-4a24-9392-c0a9f5a7c9cc" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-6977303c-5b59-4a24-9392-c0a9f5a7c9cc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Deleting offline snapshot 6977303c-5b59-4a24-9392-c0a9f5a7c9cc of volume 05f024b8-8eed-4450-988a-d22bbcd201a5 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] snapshot_file for this snap is: volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cc0195-4ab5-431b-88fc-d5644c626246]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:52 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:52 devstack sudo[108291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc
Nov 07 02:53:52 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:53 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc" returned: 0 in 0.362s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f024b8-8eed-4450-988a-d22bbcd201a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dd052f-782f-4094-8757-3c13dddda65f]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:53 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5
Nov 07 02:53:53 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:53 devstack sudo[108298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:53 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:53 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5" returned: 0 in 0.350s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:53 devstack sudo[108303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc
Nov 07 02:53:53 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:53 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.247s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:53:53 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc" returned: 0 in 0.336s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:53 devstack sudo[108309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc
Nov 07 02:53:53 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:54 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:54 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5.6977303c-5b59-4a24-9392-c0a9f5a7c9cc" returned: 0 in 0.245s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-6977303c-5b59-4a24-9392-c0a9f5a7c9cc" released by "_delete_snapshot" :: held 1.382s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-05f024b8-8eed-4450-988a-d22bbcd201a5" released by "delete_snapshot" :: held 1.403s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:54 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=222,cinder:INSERT=60,cinder:DELETE=18,cinder:SELECT=163 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:53:54 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=177,cinder:UPDATE=227,cinder:DELETE=21,cinder:INSERT=61 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:53:54 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Created reservations ['2ca10dc8-18c1-46e6-98e8-8d613bc4d305', 'cc321959-2e84-405c-af09-d9d2e3ebb035', 'b60ae4f2-b466-420c-b588-505deed0809d', 'cc136f62-8cb1-40d5-ab2e-5502d39b15b9'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:54 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Delete snapshot completed successfully.
Nov 07 02:53:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-0e5c5d35-b8f1-4828-b8b0-807edb9c4a4e tempest-ProjectMemberTests-1264181528 None] Lock "cinder-6977303c-5b59-4a24-9392-c0a9f5a7c9cc-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-05f024b8-8eed-4450-988a-d22bbcd201a5-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-05f024b8-8eed-4450-988a-d22bbcd201a5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "cinder-quobyte-05f024b8-8eed-4450-988a-d22bbcd201a5" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:54 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-05f024b8-8eed-4450-988a-d22bbcd201a5" acquired by "delete_volume" :: waited 0.021s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaa9f1f-56fd-49aa-8dec-8ef2f4c5ab0c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:55 devstack sudo[108312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5
Nov 07 02:53:55 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:55 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:55 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5
Nov 07 02:53:55 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:55 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-05f024b8-8eed-4450-988a-d22bbcd201a5" returned: 0 in 0.236s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-quobyte-05f024b8-8eed-4450-988a-d22bbcd201a5" released by "delete_volume" :: held 0.656s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Created reservations ['52bcdeca-4013-4421-a123-eaab59d3adbe', '395c692d-f82e-4c48-90dc-91fbc02c7f38', '1d34b11e-6ebf-4e74-8e4d-2d5c11d8aa42', 'bb7aa473-71a2-4707-ae65-d6559c81bf55'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:55 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:55 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:53:55 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:56 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:56 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.240s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:56 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:56 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Deleted volume successfully.
Nov 07 02:53:56 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-7d28c08d-220a-4f8a-a61a-414af8514751 tempest-ProjectMemberTests-1264181528 None] Lock "cinder-05f024b8-8eed-4450-988a-d22bbcd201a5-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Flow 'volume_create_manager' (e88436af-3ea8-4dde-a474-487f6cd29313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c563cdf-895a-44aa-ab56-e432deb8b9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c563cdf-895a-44aa-ab56-e432deb8b9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370662298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5616c066-72fe-4395-b401-6b9ae2789eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a626ea6067dd4058bdc58c684c303a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:59Z,use_quota=True,user_id='1a8c1cb76c6b4f94b9d8b0062aa773da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de48783-d8b4-4a88-98f5-0479ece892a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de48783-d8b4-4a88-98f5-0479ece892a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd6ecf0-e355-48c6-834f-eb71a6e447ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd6ecf0-e355-48c6-834f-eb71a6e447ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5616c066-72fe-4395-b401-6b9ae2789eec', 'volume_name': 'volume-5616c066-72fe-4395-b401-6b9ae2789eec', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4985e836-6336-4880-b099-90b7ac6477e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4985e836-6336-4880-b099-90b7ac6477e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44840863-a859-439c-8320-cadbf6cf68aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:59 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Volume 5616c066-72fe-4395-b401-6b9ae2789eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5616c066-72fe-4395-b401-6b9ae2789eec', 'volume_size': 1}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370662298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5616c066-72fe-4395-b401-6b9ae2789eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a626ea6067dd4058bdc58c684c303a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:59Z,use_quota=True,user_id='1a8c1cb76c6b4f94b9d8b0062aa773da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Creating volume 5616c066-72fe-4395-b401-6b9ae2789eec {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:59 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:59 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec 1073741824
Nov 07 02:53:59 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:59 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec 1073741824" returned: 0 in 0.416s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:59 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:59 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec
Nov 07 02:53:59 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:00 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec" returned: 0 in 0.238s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44840863-a859-439c-8320-cadbf6cf68aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5616c066-72fe-4395-b401-6b9ae2789eec', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29a7561-39d6-4d45-82f0-ae4f354f2061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:00 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Volume volume-5616c066-72fe-4395-b401-6b9ae2789eec (5616c066-72fe-4395-b401-6b9ae2789eec): created successfully
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29a7561-39d6-4d45-82f0-ae4f354f2061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Flow 'volume_create_manager' (e88436af-3ea8-4dde-a474-487f6cd29313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:54:00 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-7255d8a9-10d6-4926-895e-72722fdf7ad7 tempest-ProjectReaderTests-527378231 None] Created volume successfully.
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Acquiring lock "cinder-5616c066-72fe-4395-b401-6b9ae2789eec-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Lock "cinder-5616c066-72fe-4395-b401-6b9ae2789eec-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Acquiring lock "cinder-quobyte-5616c066-72fe-4395-b401-6b9ae2789eec" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Lock "cinder-quobyte-5616c066-72fe-4395-b401-6b9ae2789eec" acquired by "delete_volume" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbce14c-7bf1-4e1b-bc3f-55edac118961]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:00 devstack sudo[108332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec
Nov 07 02:54:00 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:00 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:00 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:01 devstack sudo[108337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec
Nov 07 02:54:01 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:01 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-5616c066-72fe-4395-b401-6b9ae2789eec" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Lock "cinder-quobyte-5616c066-72fe-4395-b401-6b9ae2789eec" released by "delete_volume" :: held 0.633s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Created reservations ['965ae9a5-ad11-469d-b077-a35219b0efd4', 'abd52d74-d22b-4b00-809b-008a0e05d410', '11404f72-9283-46af-aea7-435cff60c083', 'c3c3f583-6cea-4487-bbd3-b3cec318af68'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:01 devstack sudo[108340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:54:01 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:01 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.236s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:54:01 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Deleted volume successfully.
Nov 07 02:54:01 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-5cf7dacd-7c4c-4872-b0c5-279be1655022 tempest-ProjectReaderTests-527378231 None] Lock "cinder-5616c066-72fe-4395-b401-6b9ae2789eec-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Flow 'volume_create_manager' (29d9ada6-ddbc-4c66-ac37-2a955a817c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a6d982-6faf-4230-ba57-69ddcd4df5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a6d982-6faf-4230-ba57-69ddcd4df5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573495656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366db6cb-2a39-42c2-89d1-24d6bd1ce1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a626ea6067dd4058bdc58c684c303a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:54:02Z,use_quota=True,user_id='1a8c1cb76c6b4f94b9d8b0062aa773da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29647448-2447-4933-b513-ca09b7a8ecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29647448-2447-4933-b513-ca09b7a8ecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edd5b85-a9bb-4983-8f9e-0743f522989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edd5b85-a9bb-4983-8f9e-0743f522989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '366db6cb-2a39-42c2-89d1-24d6bd1ce1fc', 'volume_name': 'volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41e49b5-10b5-4784-9858-8bd9a07c69f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41e49b5-10b5-4784-9858-8bd9a07c69f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b8e4b9-30c5-4e9e-a9b8-3e02472749fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:02 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Volume 366db6cb-2a39-42c2-89d1-24d6bd1ce1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc', 'volume_size': 1}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573495656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366db6cb-2a39-42c2-89d1-24d6bd1ce1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a626ea6067dd4058bdc58c684c303a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:54:02Z,use_quota=True,user_id='1a8c1cb76c6b4f94b9d8b0062aa773da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Creating volume 366db6cb-2a39-42c2-89d1-24d6bd1ce1fc {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:54:02 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:02 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc 1073741824
Nov 07 02:54:02 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:02 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc 1073741824" returned: 0 in 0.404s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:02 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc
Nov 07 02:54:02 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:02 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc" returned: 0 in 0.248s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b8e4b9-30c5-4e9e-a9b8-3e02472749fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b08f32-9f4b-4065-aa70-d176fb858904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:02 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Volume volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc (366db6cb-2a39-42c2-89d1-24d6bd1ce1fc): created successfully
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b08f32-9f4b-4065-aa70-d176fb858904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:02 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Flow 'volume_create_manager' (29d9ada6-ddbc-4c66-ac37-2a955a817c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:54:02 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-2d3ded20-6834-4068-b94b-915dee413f7f tempest-ProjectReaderTests-527378231 None] Created volume successfully.
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Acquiring lock "cinder-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Lock "cinder-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Acquiring lock "cinder-quobyte-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Lock "cinder-quobyte-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc" acquired by "delete_volume" :: waited 0.019s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[b931d034-9c9c-480b-b4ed-326f6e5e6919]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:03 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc
Nov 07 02:54:03 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:03 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc" returned: 0 in 0.370s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:03 devstack sudo[108356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc
Nov 07 02:54:03 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:03 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc" returned: 0 in 0.254s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Lock "cinder-quobyte-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc" released by "delete_volume" :: held 0.666s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Created reservations ['2bb6a9d3-cb12-4231-bafa-218bbe12be22', 'a7eb5d2e-d82a-4ad9-aeae-1858a1be5814', '9c50048e-1322-436c-8f12-e7be8085ceb5', '19029c73-409c-403a-b100-afa9d0a7d913'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:03 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:54:04 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:54:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:04 devstack sudo[108359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:54:04 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:04 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:04 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.250s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:04 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:54:04 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Deleted volume successfully.
Nov 07 02:54:04 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-743d4150-bb81-4441-bb31-1eda3d731439 tempest-ProjectReaderTests-527378231 None] Lock "cinder-366db6cb-2a39-42c2-89d1-24d6bd1ce1fc-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:13 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=27,cinder:INSERT=9,cinder:UPDATE=34,cinder:DELETE=1 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:54:14 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:INSERT=9,cinder:UPDATE=37,cinder:SELECT=18,cinder:DELETE=4 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Flow 'volume_create_manager' (1b0faaa8-51e5-4e63-ad56-74b69a1ec70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2f6285-6d21-46eb-9d51-df4f9fbaadcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2f6285-6d21-46eb-9d51-df4f9fbaadcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-321324256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3ca445-f47f-44d6-a429-0c001aa22020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059b67e5d0df42ebbd9abd3f437f9bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:54:25Z,use_quota=True,user_id='ced351f314cd41838e3dc8f50e9b2da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fc9e8f-8d8b-45e3-bfa4-66f3e5595db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fc9e8f-8d8b-45e3-bfa4-66f3e5595db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbae8d84-455b-4675-9acb-6a5b9bb39929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbae8d84-455b-4675-9acb-6a5b9bb39929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df3ca445-f47f-44d6-a429-0c001aa22020', 'volume_name': 'volume-df3ca445-f47f-44d6-a429-0c001aa22020', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601ce8c3-9c2a-4e2e-8f31-b1046850d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601ce8c3-9c2a-4e2e-8f31-b1046850d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed467af9-65b4-4346-9214-37d34288fcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Volume df3ca445-f47f-44d6-a429-0c001aa22020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df3ca445-f47f-44d6-a429-0c001aa22020', 'volume_size': 1}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7696fbf47230>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-321324256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3ca445-f47f-44d6-a429-0c001aa22020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059b67e5d0df42ebbd9abd3f437f9bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:54:25Z,use_quota=True,user_id='ced351f314cd41838e3dc8f50e9b2da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)}" {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Creating volume df3ca445-f47f-44d6-a429-0c001aa22020 {{(pid=87087) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:54:25 devstack cinder-volume[87087]: INFO cinder.volume.drivers.remotefs [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] casted to osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 1073741824 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:25 devstack sudo[108366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 1073741824
Nov 07 02:54:25 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:25 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 1073741824" returned: 0 in 0.403s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:25 devstack sudo[108371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020
Nov 07 02:54:25 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:25 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'} {{(pid=87087) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed467af9-65b4-4346-9214-37d34288fcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3ca445-f47f-44d6-a429-0c001aa22020', 'volume_size': 1}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428205de-e6eb-42fb-b64c-d81454294c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:25 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Volume volume-df3ca445-f47f-44d6-a429-0c001aa22020 (df3ca445-f47f-44d6-a429-0c001aa22020): created successfully
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428205de-e6eb-42fb-b64c-d81454294c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:25 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Flow 'volume_create_manager' (1b0faaa8-51e5-4e63-ad56-74b69a1ec70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:54:25 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-6933c685-0a58-4a0a-9179-80224d021f9f tempest-SnapshotDependencyTests-257957670 None] Created volume successfully.
Nov 07 02:54:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:26 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] Creating offline snapshot fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb of volume df3ca445-f47f-44d6-a429-0c001aa22020 {{(pid=87087) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:54:26 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fff6761-7513-47b9-8f10-8caccaa6ec0c]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:54:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:26 devstack sudo[108375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020
Nov 07 02:54:26 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:26 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020" returned: 0 in 0.353s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:26 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb 1G {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:26 devstack sudo[108380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb 1G
Nov 07 02:54:26 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:27 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb 1G" returned: 0 in 0.378s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3ca445-f47f-44d6-a429-0c001aa22020 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:27 devstack sudo[108385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3ca445-f47f-44d6-a429-0c001aa22020 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb
Nov 07 02:54:27 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:27 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3ca445-f47f-44d6-a429-0c001aa22020 -F qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb" returned: 0 in 0.289s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:27 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb is being set with open permissions: ugo+rw
Nov 07 02:54:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:27 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb
Nov 07 02:54:27 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:27 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb" returned: 0 in 0.239s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:27 devstack sudo[108394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.info
Nov 07 02:54:27 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:27 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.info" returned: 0 in 0.243s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:27 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.info is being set with open permissions: ugo+rw
Nov 07 02:54:27 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.info {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:27 devstack sudo[108397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.info
Nov 07 02:54:27 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:28 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.info" returned: 0 in 0.235s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:28 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:28 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-03746f8c-12a8-4ef1-8815-7260e2648eef tempest-SnapshotDependencyTests-257957670 None] Create snapshot completed successfully
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87087) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Flow 'volume_create_manager' (4f8654d6-db6c-4761-9986-666ebb6dc6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88682027-fb61-4b62-9e3e-65de65d0f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88682027-fb61-4b62-9e3e-65de65d0f867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fea919-e0cb-4d90-baba-3fcf8484b40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059b67e5d0df42ebbd9abd3f437f9bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:54:29Z,use_quota=True,user_id='ced351f314cd41838e3dc8f50e9b2da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6708d-01aa-40b0-8dc4-df23c72dbb30),volume_type_id=a1f6708d-01aa-40b0-8dc4-df23c72dbb30)' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1676e89-e1d7-4b29-81a3-88870b12bd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1676e89-e1d7-4b29-81a3-88870b12bd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccac457c-af05-4406-8a63-ced1f4373771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccac457c-af05-4406-8a63-ced1f4373771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6fea919-e0cb-4d90-baba-3fcf8484b40a', 'volume_name': 'volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a', 'volume_size': 1, 'snapshot_id': 'fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081f2866-7de8-4d5c-95fe-941e7f2a4905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081f2866-7de8-4d5c-95fe-941e7f2a4905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3a4d3c-b8a6-420d-8692-8ab6584a1619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:29 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Volume b6fea919-e0cb-4d90-baba-3fcf8484b40a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a', 'volume_size': 1, 'snapshot_id': 'fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb'}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "cinder-quobyte-fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb-b6fea919-e0cb-4d90-baba-3fcf8484b40a" by "_create_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb-b6fea919-e0cb-4d90-baba-3fcf8484b40a" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Creating volume b6fea919-e0cb-4d90-baba-3fcf8484b40a from snapshot fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb {{(pid=87087) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Selected osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c as target Quobyte volume. {{(pid=87087) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "cinder-quobyte-b6fea919-e0cb-4d90-baba-3fcf8484b40a" by "_copy_volume_from_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-b6fea919-e0cb-4d90-baba-3fcf8484b40a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] snapshot: fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb, volume: b6fea919-e0cb-4d90-baba-3fcf8484b40a,  {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[811fcf57-c4d0-4912-84de-91f11d0af4f1]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:29 devstack sudo[108403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb
Nov 07 02:54:29 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:29 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb" returned: 0 in 0.358s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df3ca445-f47f-44d6-a429-0c001aa22020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ead738-c19c-4a5f-9137-91176c8703b3]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:29 devstack sudo[108408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020
Nov 07 02:54:29 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:29 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020" returned: 0 in 0.349s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Creating direct copy from snapshot {{(pid=87087) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG cinder.utils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Path /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a not found in is_blk_device check {{(pid=87087) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:54:29 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:29 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a
Nov 07 02:54:29 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:35 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a" returned: 0 in 5.858s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:35 devstack cinder-volume[87087]: DEBUG cinder.image.image_utils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Image conversion details: src /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a {{(pid=87087) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:54:35 devstack cinder-volume[87087]: INFO cinder.image.image_utils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Converted 1024.00 MB image at 174.75 MB/s
Nov 07 02:54:35 devstack cinder-volume[87087]: WARNING cinder.volume.drivers.remotefs [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a is being set with open permissions: ugo+rw
Nov 07 02:54:35 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:35 devstack sudo[108426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a
Nov 07 02:54:35 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:36 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a" returned: 0 in 0.243s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-b6fea919-e0cb-4d90-baba-3fcf8484b40a" released by "_copy_volume_from_snapshot" :: held 6.888s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb-b6fea919-e0cb-4d90-baba-3fcf8484b40a" released by "_create_volume_from_snapshot" :: held 6.944s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.958s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3a4d3c-b8a6-420d-8692-8ab6584a1619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a', 'volume_size': 1, 'snapshot_id': 'fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb'}' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab1775f-5b97-45e4-bc87-7f0ccf0b756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:54:36 devstack cinder-volume[87087]: INFO cinder.volume.flows.manager.create_volume [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Volume volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a (b6fea919-e0cb-4d90-baba-3fcf8484b40a): created successfully
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab1775f-5b97-45e4-bc87-7f0ccf0b756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87087) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Flow 'volume_create_manager' (4f8654d6-db6c-4761-9986-666ebb6dc6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87087) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:54:36 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-4ccd28b2-3665-470d-8281-5a55625a96bb tempest-SnapshotDependencyTests-257957670 None] Created volume successfully.
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "cinder-fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb-delete_snapshot" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "cinder-quobyte-df3ca445-f47f-44d6-a429-0c001aa22020" by "delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-df3ca445-f47f-44d6-a429-0c001aa22020" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "cinder-quobyte-fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb" by "_delete_snapshot" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Deleting offline snapshot fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb of volume df3ca445-f47f-44d6-a429-0c001aa22020 {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] snapshot_file for this snap is: volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb {{(pid=87087) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[c003374f-f766-4376-8275-648c0d9ddbad]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:54:36 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:36 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb
Nov 07 02:54:36 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:37 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb" returned: 0 in 0.354s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:37 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.remotefs [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df3ca445-f47f-44d6-a429-0c001aa22020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87087) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:54:37 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3fb87b-95e8-4127-a5c3-87409c420b27]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:54:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:37 devstack sudo[108434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020
Nov 07 02:54:37 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:37 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020" returned: 0 in 0.509s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:37 devstack sudo[108439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb
Nov 07 02:54:37 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:37 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb" returned: 0 in 0.323s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:37 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:37 devstack sudo[108444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb
Nov 07 02:54:37 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:38 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020.fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb" returned: 0 in 0.238s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb" released by "_delete_snapshot" :: held 1.522s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-df3ca445-f47f-44d6-a429-0c001aa22020" released by "delete_snapshot" :: held 1.543s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:38 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Created reservations ['3b0f855a-1e6f-415b-98e7-f5fb38f3b0c2', '63f4639e-f97b-4053-ba9d-c06cedbc7aa5', '58e567aa-251e-42d0-bd75-6ac1a14174b7', '4f4d33e6-2460-4094-8640-66d2dbda264f'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:54:38 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Delete snapshot completed successfully.
Nov 07 02:54:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-94ab8b64-f34d-48b6-8770-5b18da0d9018 tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-fcd4f34c-8b0e-4a01-b62c-9f1fe3915fcb-delete_snapshot" released by "delete_snapshot" :: held 1.666s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "cinder-df3ca445-f47f-44d6-a429-0c001aa22020-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-df3ca445-f47f-44d6-a429-0c001aa22020-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "cinder-quobyte-df3ca445-f47f-44d6-a429-0c001aa22020" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:38 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-df3ca445-f47f-44d6-a429-0c001aa22020" acquired by "delete_volume" :: waited 0.013s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:38 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dada51c-8cdd-41ea-a4dd-47c7c8280880]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:54:38 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:38 devstack sudo[108448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020
Nov 07 02:54:38 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:39 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020" returned: 0 in 0.359s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:39 devstack sudo[108453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020
Nov 07 02:54:39 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:39 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-df3ca445-f47f-44d6-a429-0c001aa22020" returned: 0 in 0.238s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-df3ca445-f47f-44d6-a429-0c001aa22020" released by "delete_volume" :: held 0.656s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Created reservations ['312f213b-368f-4da2-90d6-bfe5a20fb01d', 'ae3a3e6a-c42f-4a57-b1d7-6700251bba01', '75ea3e93-6915-4409-bc87-3f6b71aaa53f', '454f6e9e-a040-4a4f-8eba-ca28c697255b'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:39 devstack sudo[108456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:54:39 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:39 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.242s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:54:39 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Deleted volume successfully.
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-bc68c535-0efc-4051-8517-6b241e74cf76 tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-df3ca445-f47f-44d6-a429-0c001aa22020-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "cinder-b6fea919-e0cb-4d90-baba-3fcf8484b40a-delete_volume" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-b6fea919-e0cb-4d90-baba-3fcf8484b40a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "cinder-quobyte-b6fea919-e0cb-4d90-baba-3fcf8484b40a" by "delete_volume" {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:54:39 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-b6fea919-e0cb-4d90-baba-3fcf8484b40a" acquired by "delete_volume" :: waited 0.014s {{(pid=87087) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3b3986-2b85-4387-938a-ca986cf45d6a]: (4, 'qcow2') {{(pid=88045) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:40 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a
Nov 07 02:54:40 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:40 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a" returned: 0 in 0.343s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:40 devstack sudo[108465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a
Nov 07 02:54:40 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:40 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9/volume-b6fea919-e0cb-4d90-baba-3fcf8484b40a" returned: 0 in 0.243s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-quobyte-b6fea919-e0cb-4d90-baba-3fcf8484b40a" released by "delete_volume" :: held 0.625s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG cinder.quota [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Created reservations ['abaa32a5-bcf2-414c-89a5-bbcde0d0d110', '4fac8ca9-8e35-45f7-bb2e-b8b33c113458', 'fffd66bd-b4c8-4003-b62e-b1ed404c9299', '91fe74da-76a1-4266-a126-20ac2110d992'] {{(pid=87087) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:40 devstack sudo[108468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:54:40 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:40 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.236s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:54:40 devstack cinder-volume[87087]: INFO cinder.volume.manager [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Deleted volume successfully.
Nov 07 02:54:40 devstack cinder-volume[87087]: DEBUG cinder.coordination [None req-40c236c3-62ae-48eb-890c-17e10825d9fe tempest-SnapshotDependencyTests-257957670 None] Lock "cinder-b6fea919-e0cb-4d90-baba-3fcf8484b40a-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87087) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:54:50 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:UPDATE=22,cinder:SELECT=23,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:54:50 devstack cinder-volume[87087]: DEBUG dbcounter [-] [87087] Writing DB stats cinder:SELECT=27,cinder:UPDATE=37,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c': None} {{(pid=87087) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG cinder.volume.drivers.quobyte [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1345f04d-1e41-4b8c-931f-3571faca230c'] {{(pid=87087) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.lockutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87087) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9 {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:54:53 devstack sudo[108524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9
Nov 07 02:54:53 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:54:53 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG oslo_concurrency.processutils [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95083b3bf88d750e0ec11ab8a7c48de9" returned: 0 in 0.234s {{(pid=87087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG cinder.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Notifying Schedulers of capabilities ... {{(pid=87087) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG oslo_service.periodic_task [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87087) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread count: 28 {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:54:53 devstack cinder-volume[87087]: DEBUG cinder.volume.manager [None req-4da0ba04-7573-421b-9284-83ebe44a98a1 None None] thread info: [<_MainThread(MainThread, started 130390957031552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130390848149568)>, <Thread(Thread-3 (stat_writer), started daemon 130390843013632)>, <Thread(Rabbit-heartbeat, started daemon 130390855221952)>, <Thread(Thread-5 (_runner), started daemon 130390842903680)>, <Thread(Thread-7 (_runner), started daemon 130390840906368)>, <Thread(fd_logger, started daemon 130390838593856)>, <Thread(privsep_reader, started daemon 130390838603328)>, <Thread(tpool_thread_0, started daemon 130390830069440)>, <Thread(tpool_thread_1, started daemon 130390821676736)>, <Thread(tpool_thread_2, started daemon 130390813284032)>, <Thread(tpool_thread_3, started daemon 130390804891328)>, <Thread(tpool_thread_4, started daemon 130390796498624)>, <Thread(tpool_thread_5, started daemon 130390788105920)>, <Thread(tpool_thread_6, started daemon 130390779713216)>, <Thread(tpool_thread_7, started daemon 130390771304128)>, <Thread(tpool_thread_8, started daemon 130390762895040)>, <Thread(tpool_thread_9, started daemon 130390754485952)>, <Thread(tpool_thread_10, started daemon 130390746076864)>, <Thread(tpool_thread_11, started daemon 130390737667776)>, <Thread(tpool_thread_12, started daemon 130390729258688)>, <Thread(tpool_thread_13, started daemon 130390720849600)>, <Thread(tpool_thread_14, started daemon 130390712440512)>, <Thread(tpool_thread_15, started daemon 130390704031424)>, <Thread(tpool_thread_16, started daemon 130390695622336)>, <Thread(tpool_thread_17, started daemon 130390687213248)>, <Thread(tpool_thread_18, started daemon 130390678804160)>, <Thread(tpool_thread_19, started daemon 130390670395072)>] {{(pid=87087) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}